Apr 12 12:21:59 user devstack@n-api.service[61613]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 12:21:59 user devstack@n-api.service[61613]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 12:21:59 2023] *** Apr 12 12:21:59 user devstack@n-api.service[61613]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 12:21:59 user devstack@n-api.service[61613]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 12:21:59 user devstack@n-api.service[61613]: nodename: user Apr 12 12:21:59 user devstack@n-api.service[61613]: machine: x86_64 Apr 12 12:21:59 user devstack@n-api.service[61613]: clock source: unix Apr 12 12:21:59 user devstack@n-api.service[61613]: pcre jit disabled Apr 12 12:21:59 user devstack@n-api.service[61613]: detected number of CPU cores: 12 Apr 12 12:21:59 user devstack@n-api.service[61613]: current working directory: / Apr 12 12:21:59 user devstack@n-api.service[61613]: detected binary path: /usr/bin/uwsgi-core Apr 12 12:21:59 user devstack@n-api.service[61613]: your processes number limit is 63637 Apr 12 12:21:59 user devstack@n-api.service[61613]: your memory page size is 4096 bytes Apr 12 12:21:59 user devstack@n-api.service[61613]: detected max file descriptor number: 2048 Apr 12 12:21:59 user devstack@n-api.service[61613]: lock engine: pthread robust mutexes Apr 12 12:21:59 user devstack@n-api.service[61613]: thunder lock: enabled Apr 12 12:21:59 user devstack@n-api.service[61613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 12:21:59 user devstack@n-api.service[61613]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 12:21:59 user devstack@n-api.service[61613]: Python main interpreter initialized at 0x55f87dc71990 Apr 12 12:21:59 user devstack@n-api.service[61613]: python threads support enabled Apr 12 12:21:59 user devstack@n-api.service[61613]: your server socket listen backlog is limited to 100 connections Apr 12 12:21:59 user devstack@n-api.service[61613]: your mercy for graceful operations on workers is 90 seconds Apr 12 12:21:59 user devstack@n-api.service[61613]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 12:21:59 user devstack@n-api.service[61613]: *** Operational MODE: preforking *** Apr 12 12:21:59 user devstack@n-api.service[61613]: *** uWSGI is running in multiple interpreter mode *** Apr 12 12:21:59 user devstack@n-api.service[61613]: spawned uWSGI master process (pid: 61613) Apr 12 12:21:59 user devstack@n-api.service[61613]: spawned uWSGI worker 1 (pid: 61614, cores: 1) Apr 12 12:21:59 user devstack@n-api.service[61613]: spawned uWSGI worker 2 (pid: 61615, cores: 1) Apr 12 12:21:59 user devstack@n-api.service[61613]: spawned uWSGI worker 3 (pid: 61616, cores: 1) Apr 12 12:21:59 user devstack@n-api.service[61613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 12:21:59 user devstack@n-api.service[61616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 12:21:59 user devstack@n-api.service[61614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 12:21:59 user devstack@n-api.service[61615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 12:22:03 user devstack@n-api.service[61614]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 12:22:03 user devstack@n-api.service[61614]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 12:22:03 user devstack@n-api.service[61614]: and ``live_migration_inbound_addr`` respectively. Apr 12 12:22:03 user devstack@n-api.service[61614]: ). Its value may be silently ignored in the future. Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 12:22:03 user devstack@n-api.service[61615]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 12:22:03 user devstack@n-api.service[61615]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 12:22:03 user devstack@n-api.service[61615]: and ``live_migration_inbound_addr`` respectively. Apr 12 12:22:03 user devstack@n-api.service[61615]: ). Its value may be silently ignored in the future. Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 12:22:03 user devstack@n-api.service[61616]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 12:22:03 user devstack@n-api.service[61616]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 12:22:03 user devstack@n-api.service[61616]: and ``live_migration_inbound_addr`` respectively. Apr 12 12:22:03 user devstack@n-api.service[61616]: ). Its value may be silently ignored in the future. Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61614) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61615) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 12:22:03 user devstack@n-api.service[61614]: INFO dbcounter [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Registered counter for database nova_api Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_db.sqlalchemy.engines [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61614) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writer thread running {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61616) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 12:22:03 user devstack@n-api.service[61615]: INFO dbcounter [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Registered counter for database nova_api Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG nova.context [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f540a691-7739-42e1-92f6-c2721429f236(cell1) {{(pid=61614) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61614]: INFO dbcounter [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61614]: INFO dbcounter [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Registered counter for database nova_cell1 Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_db.sqlalchemy.engines [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61614) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_db.sqlalchemy.engines [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61614) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_db.sqlalchemy.engines [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61615) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writer thread running {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writer thread running {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writer thread running {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61616]: INFO dbcounter [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Registered counter for database nova_api Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61616) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writer thread running {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG nova.context [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f540a691-7739-42e1-92f6-c2721429f236(cell1) {{(pid=61615) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61615]: INFO dbcounter [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61615]: INFO dbcounter [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Registered counter for database nova_cell1 Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_db.sqlalchemy.engines [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61615) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG nova.context [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f540a691-7739-42e1-92f6-c2721429f236(cell1) {{(pid=61616) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writer thread running {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_db.sqlalchemy.engines [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61615) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:22:03 user devstack@n-api.service[61616]: INFO dbcounter [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61616]: INFO dbcounter [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Registered counter for database nova_cell1 Apr 12 12:22:03 user devstack@n-api.service[61614]: INFO dbcounter [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61616) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writer thread running {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61616) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG oslo_db.sqlalchemy.engines [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61614) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writer thread running {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writer thread running {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: INFO dbcounter [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG oslo_db.sqlalchemy.engines [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61615) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writer thread running {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writer thread running {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:03 user devstack@n-api.service[61616]: INFO dbcounter [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Registered counter for database nova_cell0 Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG oslo_db.sqlalchemy.engines [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61616) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 12:22:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writer thread running {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 12:22:04 user devstack@n-api.service[61614]: WARNING keystonemiddleware.auth_token [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61614]: WARNING keystonemiddleware.auth_token [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61616]: WARNING keystonemiddleware.auth_token [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61616]: WARNING keystonemiddleware.auth_token [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61615]: WARNING keystonemiddleware.auth_token [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61615]: WARNING keystonemiddleware.auth_token [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61614]: WARNING keystonemiddleware.auth_token [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61614]: WARNING keystonemiddleware.auth_token [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61614]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f87dc71990 pid: 61614 (default app) Apr 12 12:22:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:22:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001748 Apr 12 12:22:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 12:22:04 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:22:04 user devstack@n-api.service[61616]: WARNING keystonemiddleware.auth_token [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61616]: WARNING keystonemiddleware.auth_token [None req-a9ee61d7-810b-4184-81cb-c0c2182c2a59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f87dc71990 pid: 61616 (default app) Apr 12 12:22:04 user devstack@n-api.service[61615]: WARNING keystonemiddleware.auth_token [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 12:22:04 user devstack@n-api.service[61615]: WARNING keystonemiddleware.auth_token [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 12:22:04 user devstack@n-api.service[61615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f87dc71990 pid: 61615 (default app) Apr 12 12:24:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-50731e69-1299-4287-b0bf-ee1c57889d9f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001772 Apr 12 12:24:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9a559530-93a1-4f3a-8ac2-41f1705ad316 admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9a559530-93a1-4f3a-8ac2-41f1705ad316 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.386683 Apr 12 12:24:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 12:24:10 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:12 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001747 Apr 12 12:24:12 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:12 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:12 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:12 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:12 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:12 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e23dddaa-fac6-4c79-9a3c-55cf80f4a660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "vcpus": 1}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e23dddaa-fac6-4c79-9a3c-55cf80f4a660 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.329139 Apr 12 12:24:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:12 2023] POST /compute/v2.1/flavors => generated 405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:12 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fb603963-a7de-4772-9a3c-1b6757b96bbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:12 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fb603963-a7de-4772-9a3c-1b6757b96bbc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056727 Apr 12 12:24:12 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 12:24:12 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001256 Apr 12 12:24:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1ba6f533-d58d-4206-aca0-ff2a45be58a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:14 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1ba6f533-d58d-4206-aca0-ff2a45be58a8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.092703 Apr 12 12:24:14 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ac8cf0c4-110a-4747-8762-dad5778d754f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ac8cf0c4-110a-4747-8762-dad5778d754f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034563 Apr 12 12:24:14 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 12:24:14 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001263 Apr 12 12:24:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-590cc2ef-5bea-45a7-abbe-82f7b481cf12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-590cc2ef-5bea-45a7-abbe-82f7b481cf12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058233 Apr 12 12:24:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5d7f9674-0768-4429-a6e6-6264d6dfe0ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5d7f9674-0768-4429-a6e6-6264d6dfe0ed admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043558 Apr 12 12:24:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 12:24:16 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001775 Apr 12 12:24:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d5f13b97-6889-4ff4-8822-2ff78648e8ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d5f13b97-6889-4ff4-8822-2ff78648e8ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067423 Apr 12 12:24:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3ff9cb95-0e39-48a1-9822-8f890b01aa91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-3ff9cb95-0e39-48a1-9822-8f890b01aa91 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026804 Apr 12 12:24:18 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 12:24:18 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002208 Apr 12 12:24:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:20 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-df68c30a-6a9d-410b-8e08-cb7a7c89da0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-df68c30a-6a9d-410b-8e08-cb7a7c89da0b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064144 Apr 12 12:24:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024152 Apr 12 12:24:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 12:24:20 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-85aeb5d2-86e2-48bb-9de5-5dd17b20fbdd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001251 Apr 12 12:24:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2d97f3e8-71f8-4f54-8eda-127f3cea81ab admin admin] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2d97f3e8-71f8-4f54-8eda-127f3cea81ab admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.076118 Apr 12 12:24:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 12:24:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:24:24 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:24 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001612 Apr 12 12:24:24 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:24:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a3c36e24-5420-4df7-bd1b-99833cf3b87f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:25 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a3c36e24-5420-4df7-bd1b-99833cf3b87f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.329555 Apr 12 12:24:25 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:24 2023] POST /compute/v2.1/flavors => generated 400 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ab4ba23e-2a55-46b3-97b3-06e3b00fad67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ab4ba23e-2a55-46b3-97b3-06e3b00fad67 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065417 Apr 12 12:24:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 12:24:25 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001351 Apr 12 12:24:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:27 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0baa1e7c-56a3-4c36-96db-0f3f9a67ae88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "vcpus": 1}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:27 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0baa1e7c-56a3-4c36-96db-0f3f9a67ae88 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060495 Apr 12 12:24:27 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:27 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:27 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e6ab1653-439b-4857-ac0a-831ac4d162ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:27 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e6ab1653-439b-4857-ac0a-831ac4d162ef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032539 Apr 12 12:24:27 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 12:24:27 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001389 Apr 12 12:24:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3c6700a4-5186-4536-998f-c766cdebef71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3c6700a4-5186-4536-998f-c766cdebef71 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063028 Apr 12 12:24:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:29 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-02815232-334b-4e21-a4bc-92cbf978f593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-02815232-334b-4e21-a4bc-92cbf978f593 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027491 Apr 12 12:24:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 12:24:29 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001407 Apr 12 12:24:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:31 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-636a37d1-7d56-44c7-a0c5-8f0ba0f2dcdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "swap": 0}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-636a37d1-7d56-44c7-a0c5-8f0ba0f2dcdc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056280 Apr 12 12:24:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:31 2023] POST /compute/v2.1/flavors => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:31 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2cc2dc90-78ee-42d2-bc7a-32228e43f983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2cc2dc90-78ee-42d2-bc7a-32228e43f983 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027623 Apr 12 12:24:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 12:24:31 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:24:33 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:24:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001513 Apr 12 12:24:33 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 12:24:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:24:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9447b1c6-ccf9-4034-beb3-e4187df4b4c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "name": "m1.xlarge"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9447b1c6-ccf9-4034-beb3-e4187df4b4c2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.061818 Apr 12 12:24:33 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 12:24:33 2023] POST /compute/v2.1/flavors => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:24:33 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2d85bc22-8cd9-465d-95fb-18317db011fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:24:33 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2d85bc22-8cd9-465d-95fb-18317db011fb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026053 Apr 12 12:24:33 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 12:24:33 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:25:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30499bdf-3eed-437e-99eb-67205a1ef24e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001615 Apr 12 12:25:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 12:25:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:25:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:25:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.086977 Apr 12 12:25:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 12:25:04 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 12:25:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2d85bc22-8cd9-465d-95fb-18317db011fb admin admin] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2d85bc22-8cd9-465d-95fb-18317db011fb admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002728 Apr 12 12:25:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 12:25:37 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:25:37 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:25:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-24c178d6-bec4-4005-8bc2-80ba2f9cc214 admin admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-24c178d6-bec4-4005-8bc2-80ba2f9cc214 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.074581 Apr 12 12:25:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 12:25:37 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:25:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001688 Apr 12 12:25:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 12:25:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:25:41 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:25:41 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fad23aa0-2389-439e-8bd3-646f9a8bd6b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 128, "swap": 0, "name": "m1.nano", "vcpus": 1}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:25:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fad23aa0-2389-439e-8bd3-646f9a8bd6b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068009 Apr 12 12:25:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 12:25:41 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:25:41 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d12cd703-de57-4b7f-8ec8-7ae87d1eebb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:25:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d12cd703-de57-4b7f-8ec8-7ae87d1eebb6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024974 Apr 12 12:25:41 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 12:25:41 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:25:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:25:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7faba385-9275-4242-86db-da797c3a6593 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001723 Apr 12 12:25:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 12:25:45 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:25:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8ea0956c-378d-48a1-971a-5195cb3e0dec admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "swap": 0, "disk": 1, "name": "m1.micro", "id": "84", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:25:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8ea0956c-378d-48a1-971a-5195cb3e0dec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063292 Apr 12 12:25:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 12:25:45 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:25:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-23899ffe-924a-4c42-b444-1934196ef1be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:25:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-23899ffe-924a-4c42-b444-1934196ef1be admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024296 Apr 12 12:25:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 12:25:45 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:27:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:27:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:27:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:27:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-920bdf67-204b-484f-9741-5b4a1cac876e tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Action: 'create', calling method: .version_select at 0x7fc95e275b40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1790667086", "metadata": {"Type": "work"}}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-920bdf67-204b-484f-9741-5b4a1cac876e tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.149862 Apr 12 12:28:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 12:27:58 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 2153 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 12:28:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ab1159e2-e177-4a3a-8a0e-be320ceb35aa tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e2a7520>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ab1159e2-e177-4a3a-8a0e-be320ceb35aa tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 353 microversion: 2.1 time: 0.263098 Apr 12 12:28:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:00 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-16d950db-176f-4bda-be8e-7ef0e0068556 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e3b30a0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-16d950db-176f-4bda-be8e-7ef0e0068556 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 354 microversion: 2.1 time: 0.614789 Apr 12 12:28:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:01 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 354 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-852f9a30-110a-4c74-9aac-0d0b8ef9036c tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e134dc0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-852f9a30-110a-4c74-9aac-0d0b8ef9036c tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 354 microversion: 2.1 time: 0.060219 Apr 12 12:28:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:02 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:02 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fa5d780c-d180-4a20-b626-bdc2af3b4539 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e11f7f0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fa5d780c-d180-4a20-b626-bdc2af3b4539 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 202 len: 0 microversion: 2.1 time: 0.118821 Apr 12 12:28:02 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:28:02 2023] DELETE /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:28:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-cc643b0f-9344-4a65-a896-b1ba3ba835e9 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e123010>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-cc643b0f-9344-4a65-a896-b1ba3ba835e9 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 353 microversion: 2.1 time: 0.050016 Apr 12 12:28:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:02 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bb9f7f38-9a74-4ff8-b2c0-97b5630726df tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e135120>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-bb9f7f38-9a74-4ff8-b2c0-97b5630726df tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 353 microversion: 2.1 time: 0.064573 Apr 12 12:28:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:03 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e025876d-cfba-4981-807f-1c1d03c475c8 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e11feb0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e025876d-cfba-4981-807f-1c1d03c475c8 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 353 microversion: 2.1 time: 0.054931 Apr 12 12:28:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:04 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-cec7fbf8-6ccb-4178-899f-2abcc7f3bb57 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e1236d0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-cec7fbf8-6ccb-4178-899f-2abcc7f3bb57 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 200 len: 353 microversion: 2.1 time: 0.074810 Apr 12 12:28:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:05 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d3ceb250-a0c2-4bd7-821b-a495fb28a602 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Calling method '.version_select at 0x7fc95e135510>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-d3ceb250-a0c2-4bd7-821b-a495fb28a602 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] HTTP exception thrown: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. Apr 12 12:28:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d3ceb250-a0c2-4bd7-821b-a495fb28a602 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Request method failure captured: Apr 12 12:28:06 user devstack@n-api.service[61615]: request: GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde HTTP/1.1 Apr 12 12:28:06 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:28:06 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:28:06 user devstack@n-api.service[61615]: Connection: close Apr 12 12:28:06 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:28:06 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:28:06 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:28:06 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:28:06 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPOj8YKUPduteosmCA2-0vzTBYwypCnDedwAS8iXE6Sd_ndvuGDQbDOVLUNCcVKBoOgz8XdCbEt4Cw7y32qBtstAmtXdlB_Bx38ma9XH8nYon2fFu-Dkj-KIndv8tINLyGgmKHkgufzDzvh7LXM5R5Nr4Eq1T8DK-fiWJ1WK8Di79k Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Project-Id: 472e8bae6f5143c99c1801596cf1c12b Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesGetTestJSON-161504881 Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/472e8bae6f5143c99c1801596cf1c12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/472e8bae6f5143c99c1801596cf1c12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/472e8bae6f5143c99c1801596cf1c12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesGetTestJSON-161504881 Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Tenant-Id: 472e8bae6f5143c99c1801596cf1c12b Apr 12 12:28:06 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesGetTestJSON-161504881 Apr 12 12:28:06 user devstack@n-api.service[61615]: X-User: tempest-VolumesGetTestJSON-161504881-project-member Apr 12 12:28:06 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:28:06 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:28:06 user devstack@n-api.service[61615]: X-User-Id: 892ba432aad2497cb491fe0ff93fa347 Apr 12 12:28:06 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesGetTestJSON-161504881-project-member Apr 12 12:28:06 user devstack@n-api.service[61615]: method: Apr 12 12:28:06 user devstack@n-api.service[61615]: exception: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. Apr 12 12:28:06 user devstack@n-api.service[61615]: action_args: {'id': '55741d9e-fea9-4379-96ed-c6c4c1d7dcde'} Apr 12 12:28:06 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. (HTTP 404) (Request-ID: req-945f7167-2431-4f65-8819-ed82c54b20c6) Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. Apr 12 12:28:07 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:28:07 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d3ceb250-a0c2-4bd7-821b-a495fb28a602 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] Returning 404 to user: Volume 55741d9e-fea9-4379-96ed-c6c4c1d7dcde could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:28:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d3ceb250-a0c2-4bd7-821b-a495fb28a602 tempest-VolumesGetTestJSON-161504881 tempest-VolumesGetTestJSON-161504881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde" status: 404 len: 109 microversion: 2.1 time: 0.036763 Apr 12 12:28:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:06 2023] GET /compute/v2.1/os-volumes/55741d9e-fea9-4379-96ed-c6c4c1d7dcde => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:28:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1720191836", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:11 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] validate_networks() for [('0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:12 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2cfe7c92-93bd-4972-a8df-5d85bd566ae9 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e123d90>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:12 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2cfe7c92-93bd-4972-a8df-5d85bd566ae9 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/953a0556-b0e9-49de-a5b7-cb4d40e88a8f" status: 200 len: 351 microversion: 2.1 time: 0.073617 Apr 12 12:28:12 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:12 2023] GET /compute/v2.1/os-volumes/953a0556-b0e9-49de-a5b7-cb4d40e88a8f => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for user 1db0203a6e6f4cc3bccbf19577a0c82f and project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a3bb688c-a440-4bc6-8cb3-0579dfe2a10c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.517277 Apr 12 12:28:13 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 20/57] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:10 2023] POST /compute/v2.1/servers => generated 381 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7294ed1f-09ac-49e4-b1af-43d0b34bc727 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:13 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7294ed1f-09ac-49e4-b1af-43d0b34bc727 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:13 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-7294ed1f-09ac-49e4-b1af-43d0b34bc727 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7294ed1f-09ac-49e4-b1af-43d0b34bc727 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1216 microversion: 2.1 time: 0.143333 Apr 12 12:28:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:13 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-633086399", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-56eb58b3-2778-4895-9fd9-8c7c292a1518 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1f9ab0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-56eb58b3-2778-4895-9fd9-8c7c292a1518 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/695c0312-d5b8-4d30-bdac-68e72e96bcff" status: 200 len: 351 microversion: 2.1 time: 0.051730 Apr 12 12:28:13 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:13 2023] GET /compute/v2.1/os-volumes/695c0312-d5b8-4d30-bdac-68e72e96bcff => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:13 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] validate_networks() for [('0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7fad2443-ebb0-4ac5-8a75-b6ca0c5339e1 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1379a0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7fad2443-ebb0-4ac5-8a75-b6ca0c5339e1 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9639cc16-dec3-424d-b5d8-8a86838f28b0" status: 200 len: 351 microversion: 2.1 time: 0.081913 Apr 12 12:28:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes/9639cc16-dec3-424d-b5d8-8a86838f28b0 => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-af23d883-0d35-4f4e-a553-7a259ff74a18 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1fa170>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-af23d883-0d35-4f4e-a553-7a259ff74a18 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.111494 Apr 12 12:28:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 22/61] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-94edb9cb-b847-4a73-b40d-a47faa98700a tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1cd000>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-94edb9cb-b847-4a73-b40d-a47faa98700a tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.095001 Apr 12 12:28:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c56f31b4-00a0-4796-9956-dfc806b62e04 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1f9ea0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c56f31b4-00a0-4796-9956-dfc806b62e04 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.090585 Apr 12 12:28:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 23/63] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8d82e76c-c318-49ea-b265-91893260d1ff tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e136710>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8d82e76c-c318-49ea-b265-91893260d1ff tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103439 Apr 12 12:28:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 22/64] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ad30dd1d-5955-4169-8f9b-250f4766665e tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1f9c60>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ad30dd1d-5955-4169-8f9b-250f4766665e tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087808 Apr 12 12:28:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 24/65] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f9790a53-3193-4cf1-a2eb-078b92d86ff3 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1cce50>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f9790a53-3193-4cf1-a2eb-078b92d86ff3 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083839 Apr 12 12:28:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-690cdbc0-9086-4f30-a4b2-c5efc958eba0 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e1fb760>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:15 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:15 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:15 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:15 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:15 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-690cdbc0-9086-4f30-a4b2-c5efc958eba0 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.156459 Apr 12 12:28:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 25/67] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 12:28:15 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a192034c-685f-4591-a976-2e6858f8e1c7 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] Calling method '.version_select at 0x7fc95e137640>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for user 1db0203a6e6f4cc3bccbf19577a0c82f and project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a192034c-685f-4591-a976-2e6858f8e1c7 tempest-VolumesTestJSON-628780438 tempest-VolumesTestJSON-628780438-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.104332 Apr 12 12:28:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 24/68] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 12:28:16 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-195b0530-2e2c-4ab4-887b-601d9c468dca tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.492798 Apr 12 12:28:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 20/69] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:13 2023] POST /compute/v2.1/servers => generated 381 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-52362f5f-97bd-4f71-b31b-940b3b66acfa tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:16 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-52362f5f-97bd-4f71-b31b-940b3b66acfa tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:16 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-52362f5f-97bd-4f71-b31b-940b3b66acfa tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-52362f5f-97bd-4f71-b31b-940b3b66acfa tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 200 len: 1215 microversion: 2.1 time: 0.233076 Apr 12 12:28:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 26/70] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:16 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-baea616e-f1e3-4b99-b2c4-84de8f2f9ec1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: .version_select at 0x7fc95e1ccf70>, body: {"keypair": {"name": "tempest-keypair-1245622558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e64miZ/iyVASS4OS8AZthMPT8KBHm0byN/8NFP7U1AgI9/hOw/R+BSPozX14usgKt+VEqTE1BPs7aRGcfyuCZ/K0LBkD7enTbPYgw3NHHlO3PWScCWY1ae7IFb2uJEw=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:18 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-baea616e-f1e3-4b99-b2c4-84de8f2f9ec1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:18 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-baea616e-f1e3-4b99-b2c4-84de8f2f9ec1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-baea616e-f1e3-4b99-b2c4-84de8f2f9ec1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.506677 Apr 12 12:28:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:28:18 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1808317084", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "92e6cafe-3321-4251-bb51-8cd4315282b7"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:21 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] validate_networks() for [('92e6cafe-3321-4251-bb51-8cd4315282b7', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Creating event network-changed:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61614) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9808f7d4-e642-48f4-8434-156858b4521c req-e1c37646-a185-46a3-a9bf-77b2640d8fd6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61614) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-09991dbb-6dff-4988-a492-ee75bde7a85e tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'create', calling method: .version_select at 0x7fc95e0396c0>, body: {"keypair": {"name": "tempest-keypair-1613417814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbjsmMAk7TgSJuVPAPMbe+S9lCblPJCLl74ltjr7B+GvM2NkPL65YFl6sPwYL2BIrtM9phc+NecEtUrIGkGO+1xCyg6wipPFufRoi6dOJI6CI4+oKRDt9+nYbnf0HP/Kw=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:22 user devstack@n-api.service[61614]: INFO nova.compute.rpcapi [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 12:28:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] Releasing lock "compute-rpcapi-router" {{(pid=61614) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 12:28:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-166d985e-d986-41f8-8b79-2b8e79b39437 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436087 Apr 12 12:28:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 27/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:22 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-09991dbb-6dff-4988-a492-ee75bde7a85e tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting quotas for project 3b1faa529d424800900e10a7ceaa63d4. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:22 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-09991dbb-6dff-4988-a492-ee75bde7a85e tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting quotas for user d76f02dd70664dfea34586abbc213526 and project 3b1faa529d424800900e10a7ceaa63d4. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-09991dbb-6dff-4988-a492-ee75bde7a85e tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348928 Apr 12 12:28:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 26/73] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:28:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Getting quotas for project 5c8ee9df3d2043fb818cc565b1d3e9d2. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Getting quotas for user f0d432191ea141a58407f7b21d077b58 and project 5c8ee9df3d2043fb818cc565b1d3e9d2. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c530baf9-f1ba-4f93-afd4-c69e047da2f5 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.884899 Apr 12 12:28:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 21/74] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1ee4c958-0c89-4733-b9ee-03c2f021e536 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:23 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1ee4c958-0c89-4733-b9ee-03c2f021e536 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:23 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1ee4c958-0c89-4733-b9ee-03c2f021e536 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d432191ea141a58407f7b21d077b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8ee9df3d2043fb818cc565b1d3e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1ee4c958-0c89-4733-b9ee-03c2f021e536 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 200 len: 1209 microversion: 2.1 time: 0.152279 Apr 12 12:28:23 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 28/75] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:23 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 1209 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Creating event network-changed:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61615) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9b65725c-5d24-4afc-8edf-62a196dcd0b0 req-665a040d-4980-4cf4-9803-dcab777b12eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=61615) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:24 user devstack@n-api.service[61615]: INFO nova.compute.rpcapi [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 12:28:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61615) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 12:28:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-6dc41c4d-1853-490d-9607-438dcfd871f8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157168 Apr 12 12:28:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:25 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1139912608", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6bd5aca2-dc12-4f05-af95-523f7a183a5d"}], "security_groups": [{"name": "tempest-securitygroup--1251524765"}], "key_name": "tempest-keypair-1245622558", "user_data": "}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:26 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] validate_networks() for [('6bd5aca2-dc12-4f05-af95-523f7a183a5d', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e32e23a0-c7d3-47fa-809c-8965ab740682 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.016289 Apr 12 12:28:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 22/77] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:25 2023] POST /compute/v2.1/servers => generated 407 bytes in 3019 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f0971654-83b3-4772-a2fa-c159271869c5 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:28 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-f0971654-83b3-4772-a2fa-c159271869c5 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:28 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-f0971654-83b3-4772-a2fa-c159271869c5 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-f0971654-83b3-4772-a2fa-c159271869c5 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1233 microversion: 2.1 time: 0.138722 Apr 12 12:28:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 29/78] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:28 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1233 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-880464121", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "b6e89fad-c9f7-473e-ab76-3f005281cc95"}], "security_groups": [{"name": "tempest-securitygroup--2095609682"}], "key_name": "tempest-keypair-1613417814", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:29 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] validate_networks() for [('b6e89fad-c9f7-473e-ab76-3f005281cc95', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61616) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ae09a925-d48f-4455-97af-e1567fb58b33 req-32f8cd15-349f-422b-bb43-41dfba319663 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61616) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:29 user devstack@n-api.service[61616]: INFO nova.compute.rpcapi [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 12:28:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] Releasing lock "compute-rpcapi-router" {{(pid=61616) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 12:28:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2c896bf8-b7ee-43f5-af99-a77bce9ba7df None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103257 Apr 12 12:28:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 23/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:28:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-53fbceaf-2935-491a-a698-1df2202cdb18 req-5b480fad-0d3c-42a7-8dda-dd679ad608b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049425 Apr 12 12:28:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 30/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting quotas for project 3b1faa529d424800900e10a7ceaa63d4. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Getting quotas for user d76f02dd70664dfea34586abbc213526 and project 3b1faa529d424800900e10a7ceaa63d4. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8e3495f7-1f12-444f-adad-71b5cfe4ee4c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.148101 Apr 12 12:28:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-52ff4fbb-2af4-49f7-896e-3a15f2268484 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:31 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-52ff4fbb-2af4-49f7-896e-3a15f2268484 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:31 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:28:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-493d790f-f9f9-43ba-a1c9-f2bae6d564a4 req-a6db1ac0-1662-48dd-987a-f58426b0edf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043143 Apr 12 12:28:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 31/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:31 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-52ff4fbb-2af4-49f7-896e-3a15f2268484 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-52ff4fbb-2af4-49f7-896e-3a15f2268484 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1239 microversion: 2.1 time: 0.549222 Apr 12 12:28:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 24/83] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:31 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1239 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:32 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:28:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-9f7fa6f2-72db-4962-bebe-97f08f75ce65 req-dc9410fe-fa14-4033-a0ef-61d6a2686d2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070209 Apr 12 12:28:32 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:34 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:34 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] Creating event network-changed:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:28:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-4e4ca30b-6ebc-42c8-9b8f-8585b61d9c9a req-bf6fae40-1ac9-423f-8198-fd687fdb1c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050125 Apr 12 12:28:34 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 32/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] Creating event network-changed:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:28:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-fbd8b21d-139c-4e63-a9ab-287f260e9887 req-c2959611-8c02-45ce-b3ef-6a8149482a19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054312 Apr 12 12:28:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 25/86] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "name": "network-vif-plugged", "status": "completed", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] Creating event network-vif-plugged:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:28:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-612e571b-13b2-4b59-9664-ac825cc07632 req-33b0ebaf-6a6a-4b47-b8dc-3a8e1253c6b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035572 Apr 12 12:28:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:39 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "name": "network-vif-plugged", "status": "completed", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] Creating event network-vif-plugged:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:28:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f29a01c4-2662-43b5-8e2d-32c49ecb9c61 req-a577905d-a3a3-41a4-b60e-fe33d569fb82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Apr 12 12:28:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 33/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:40 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:40 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:28:40 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-d2b421d0-5f69-4b5c-8a8e-cb662ade6152 req-6d9cb073-4ad2-4833-b491-734f3e4e9d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072368 Apr 12 12:28:40 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 26/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=16 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] Creating event network-changed:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:28:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-730f0880-ff44-477c-be12-9120529922d1 req-3ff38035-31e9-4186-a615-f6a8c58c5864 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051603 Apr 12 12:28:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=15 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:28:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-e8642269-bf2f-4005-aa47-ee32e488dd15 req-7ea60977-ba41-444f-a2ad-782bb97e2702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125511 Apr 12 12:28:42 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 34/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=20 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:45 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=15 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:28:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-bcd9ca6c-78a3-4f00-a73a-a3966ad0ff53 req-e22689b7-6ab3-4817-9d7f-3d61a19d6d35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239457 Apr 12 12:28:45 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 27/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9afa342b-ede6-40d2-82d3-411a87ebbab4 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Action: 'create', calling method: .version_select at 0x7fc95e09ff40>, body: {"keypair": {"name": "tempest-keypair-817895902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoVgvWo88zPXxgfw7yjbHEryzhu42eYfncF0zIc/WtRssu6+d2LdfKHNGIeYY5Ua3QamFBJReIJokD0D4DEooB6gLRQnf+LJjd3K8nLB1AaWWi0tP4V51n7O7M9NtNegg=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:47 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=5 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:47 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-9afa342b-ede6-40d2-82d3-411a87ebbab4 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting quotas for project 02f3f538463546f9a0eab47df52e2f56. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:47 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-9afa342b-ede6-40d2-82d3-411a87ebbab4 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting quotas for user 66e3fb7903c94cd6a2a709ca0e133ce2 and project 02f3f538463546f9a0eab47df52e2f56. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:47 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9afa342b-ede6-40d2-82d3-411a87ebbab4 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.595054 Apr 12 12:28:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 32/93] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:28:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:28:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-58d5f3fb-d174-4208-a671-bdee7bad54a0 req-34bba52d-cd3a-40b2-88ef-46463b4528a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078954 Apr 12 12:28:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 35/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-8dd93516-847b-4cf5-a9ff-894317030c26 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Action: 'create', calling method: .version_select at 0x7fc95d8639a0>, body: {"keypair": {"name": "tempest-keypair-1155106394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYnP1AePrADpa6JilldYtpPDptoIe9CTMXo+FcAEyhImA2xpG2q/0PpsCiqXJ220TNxIISIHyWrM0NQBvRGn3XwfGqZw4o8/KRoBf74FQaJ9aKltnL+xfRvmZLxzK5W4Q=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:48 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-8dd93516-847b-4cf5-a9ff-894317030c26 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting quotas for project d5c4688a3b0b429fb12d12ab7bd14e43. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:48 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-8dd93516-847b-4cf5-a9ff-894317030c26 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting quotas for user 2991a85234e046698761e54b1f203861 and project d5c4688a3b0b429fb12d12ab7bd14e43. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-8dd93516-847b-4cf5-a9ff-894317030c26 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137522 Apr 12 12:28:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 28/95] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:28:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1796205714", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "7e291b14-2505-4769-a423-3025cafb6fbc"}], "security_groups": [{"name": "tempest-securitygroup--1522898736"}], "key_name": "tempest-keypair-1155106394", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:50 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] validate_networks() for [('7e291b14-2505-4769-a423-3025cafb6fbc', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:51 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-662121220", "imageRef": "875251de-7186-4c31-a652-86e2ae4f852c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ed1e01b0-282c-4171-88ab-4f0eb80724e2"}], "security_groups": [{"name": "tempest-securitygroup--1342329333"}], "key_name": "tempest-keypair-817895902", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:51 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] validate_networks() for [('ed1e01b0-282c-4171-88ab-4f0eb80724e2', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2bb8b9a1-e75c-46ea-a69d-45a226a54c5e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Action: 'create', calling method: .version_select at 0x7fc95d863b50>, body: {"keypair": {"name": "tempest-keypair-134546144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxGfNEhwxyml0RYHshQIBVlikZPUICMVOtWr1cX5kE9lM3qDUztZplY9zWTLExsTj4Jyt4GyZTZtlPvLt0Z2/a5v2pzKXPmtIr/OlOJ6S/2MsrCvF+uqljaJkNsq+Gqvw=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting quotas for project d5c4688a3b0b429fb12d12ab7bd14e43. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Getting quotas for user 2991a85234e046698761e54b1f203861 and project d5c4688a3b0b429fb12d12ab7bd14e43. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-2bb8b9a1-e75c-46ea-a69d-45a226a54c5e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting quotas for project 0dd2a4a665514d0eb31653775b67356a. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-2bb8b9a1-e75c-46ea-a69d-45a226a54c5e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting quotas for user 2ff191ffb9604795bab6ada1eafd41ff and project 0dd2a4a665514d0eb31653775b67356a. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2bb8b9a1-e75c-46ea-a69d-45a226a54c5e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.111262 Apr 12 12:28:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 29/96] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 12:28:52 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:28:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-198109c3-fc5d-48c4-9cd2-2a45e53c0c87 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.878169 Apr 12 12:28:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5f0eee8e-4211-4f9f-b5d7-84e19dad54bf tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5f0eee8e-4211-4f9f-b5d7-84e19dad54bf tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:52 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-5f0eee8e-4211-4f9f-b5d7-84e19dad54bf tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2991a85234e046698761e54b1f203861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c4688a3b0b429fb12d12ab7bd14e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5f0eee8e-4211-4f9f-b5d7-84e19dad54bf tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8" status: 200 len: 1226 microversion: 2.1 time: 0.104492 Apr 12 12:28:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 30/98] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:52 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting quotas for project 02f3f538463546f9a0eab47df52e2f56. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Getting quotas for user 66e3fb7903c94cd6a2a709ca0e133ce2 and project 02f3f538463546f9a0eab47df52e2f56. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='875251de-7186-4c31-a652-86e2ae4f852c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-048d09a2-af6b-435c-9bf4-989383e0fb78 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.630821 Apr 12 12:28:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 36/99] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:28:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9dfc0889-0902-4257-97cb-864152c7da65 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9dfc0889-0902-4257-97cb-864152c7da65 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-9dfc0889-0902-4257-97cb-864152c7da65 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e3fb7903c94cd6a2a709ca0e133ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f3f538463546f9a0eab47df52e2f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9dfc0889-0902-4257-97cb-864152c7da65 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 200 len: 1238 microversion: 2.1 time: 0.159939 Apr 12 12:28:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:28:52 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 1238 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:28:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-656063872", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a751f1e2-998e-4446-b94e-4bab0dc80db7"}], "security_groups": [{"name": "tempest-securitygroup--2113398287"}], "key_name": "tempest-keypair-134546144", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:54 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] validate_networks() for [('a751f1e2-998e-4446-b94e-4bab0dc80db7', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting quotas for project 0dd2a4a665514d0eb31653775b67356a. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Getting quotas for user 2ff191ffb9604795bab6ada1eafd41ff and project 0dd2a4a665514d0eb31653775b67356a. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:28:55 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:28:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b08a2e6b-7d9a-4980-b5ed-f5c651a419a8 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.711422 Apr 12 12:28:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 31/101] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 12:28:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:28:55 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:28:55 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:28:55 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:55 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:55 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:28:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-15e6a51f-004c-4993-8142-8cde66ad9444 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 200 len: 1319 microversion: 2.49 time: 0.090275 Apr 12 12:28:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 37/102] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:28:55 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:28:56 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] Creating event network-changed:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:28:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-8c177b09-67bf-4de4-b611-d101f101cd52 req-639fc216-195d-48a8-926c-05e39e5f08b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043418 Apr 12 12:28:56 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:28:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:28:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:28:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:28:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:28:57 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] Creating event network-changed:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:28:57 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-220d1cf3-7fcc-4785-9965-e2722bf12e51 req-4865239a-923c-4c60-b378-8592da967ced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Apr 12 12:28:57 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 32/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "name": "network-vif-plugged", "status": "completed", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] Creating event network-vif-plugged:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:29:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-999aee71-77f4-44ff-ae24-9a0f5c68e444 req-44c26820-b750-4613-8731-938f0f55d087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029523 Apr 12 12:29:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 38/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:02 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}, {"server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "name": "network-vif-plugged", "status": "completed", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Creating event network-changed:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:29:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] Creating event network-vif-plugged:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:29:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-3d8e2065-ea9b-4564-964c-6b7a70892642 req-aa76821d-7fb0-49a5-ac1f-de59fcc2d590 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058230 Apr 12 12:29:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:29:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "name": "network-vif-plugged", "status": "completed", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] Creating event network-vif-plugged:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:29:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-967d7f1f-fc07-4418-b5a4-41898df00ae6 req-3adf0dd6-46b5-4651-960b-c300d4282c1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072610 Apr 12 12:29:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 33/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "name": "network-vif-plugged", "status": "completed", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}, {"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}, {"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:04 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Creating event network-vif-plugged:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:29:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Creating event network-vif-plugged:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:29:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] Creating event network-vif-plugged:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:29:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-62eb13e7-2cb6-4229-8f20-75a79188a15a req-2428fd42-0014-42d7-95a7-221255f78495 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047963 Apr 12 12:29:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 39/108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:06 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f9fdef41-162b-4005-9379-620332ba2f3b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 200 len: 1504 microversion: 2.1 time: 0.409561 Apr 12 12:29:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:06 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:29:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1737375268", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "407eecd9-4bb0-4a47-9111-1ee218d6272c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:09 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:09 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=16 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:10 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:29:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='407eecd9-4bb0-4a47-9111-1ee218d6272c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:29:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-14f7f357-b866-4d77-a17e-9fbb8a4dd429 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.457559 Apr 12 12:29:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 34/110] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:29:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:29:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0a7e67e7-96e1-4dfd-ad30-b8d288d761bf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:11 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0a7e67e7-96e1-4dfd-ad30-b8d288d761bf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:11 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-0a7e67e7-96e1-4dfd-ad30-b8d288d761bf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0a7e67e7-96e1-4dfd-ad30-b8d288d761bf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 200 len: 1052 microversion: 2.1 time: 0.406826 Apr 12 12:29:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 40/111] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:11 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 1052 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:13 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d432191ea141a58407f7b21d077b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8ee9df3d2043fb818cc565b1d3e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c9078836-9d30-48c4-b9bc-82aba5acf204 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 200 len: 1491 microversion: 2.1 time: 0.198870 Apr 12 12:29:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:13 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 1491 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] Creating event network-changed:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:29:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-02336c52-d31c-4579-ba63-1425a52e03f2 req-d91e85f1-3cf5-412c-a9f3-112fc2951074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036649 Apr 12 12:29:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 35/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=9 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:18 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2e4cb40e-90e5-4744-bf4e-e6492c1c9f41 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1541 microversion: 2.1 time: 0.380078 Apr 12 12:29:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 41/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:18 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1541 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ba9bced9-010c-4a27-9250-8ff05d37bb8d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Action: 'create', calling method: .version_select at 0x7fc95d72dcf0>, body: {"keypair": {"name": "tempest-keypair-1404432695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzJQXzt1AYOf4lFnoJZvCjH3+G3z3Xlj83+ey7m3OEW9t8n5k8TLfR+L2ikcKnDMFMmln4QvSg9XLtbDzFTnjllywjp5FJCi4mQrVJZGB6DYL5ifjmZNLoATW9/WbDgrg=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:19 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-ba9bced9-010c-4a27-9250-8ff05d37bb8d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting quotas for project ed98064a134b4603bbf641f45988564a. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:29:19 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-ba9bced9-010c-4a27-9250-8ff05d37bb8d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting quotas for user b1cf68007f18458b9824e056151f5c57 and project ed98064a134b4603bbf641f45988564a. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:29:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ba9bced9-010c-4a27-9250-8ff05d37bb8d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.054510 Apr 12 12:29:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 39/115] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 12:29:19 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:29:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1511709584", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "200ada24-4b99-42e5-9085-07900a59a716"}, {"port": "c698ebb6-016a-4988-8c8a-7a75252a7944", "tag": "port-1"}, {"port": "bb10902a-003e-4c1a-85a8-194f040a1ffb", "tag": "port-2"}, {"uuid": "623863b1-0de3-49d4-b240-59885c22eb51", "tag": "net-1"}, {"uuid": "623863b1-0de3-49d4-b240-59885c22eb51"}, {"uuid": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f67d6710-fe9f-4d97-935e-535e0202f0ae", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b0cc7840-90f7-4311-8c15-78c644bad569", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "03750d10-be51-41e7-8ffe-78d0af572b24", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1919294632"}], "key_name": "tempest-keypair-1404432695", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:21 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] validate_networks() for [('200ada24-4b99-42e5-9085-07900a59a716', None, None, None, None, None), (None, None, 'c698ebb6-016a-4988-8c8a-7a75252a7944', None, None, None), (None, None, 'bb10902a-003e-4c1a-85a8-194f040a1ffb', None, None, None), ('623863b1-0de3-49d4-b240-59885c22eb51', None, None, None, None, None), ('623863b1-0de3-49d4-b240-59885c22eb51', None, None, None, None, None), ('f67d6710-fe9f-4d97-935e-535e0202f0ae', '10.2.2.100', None, None, None, None), ('f67d6710-fe9f-4d97-935e-535e0202f0ae', '10.2.2.200', None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:22 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0b0044a4-9d0f-460a-a9c8-985ba573537b tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1552 microversion: 2.1 time: 0.196848 Apr 12 12:29:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 42/116] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:22 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting quotas for project ed98064a134b4603bbf641f45988564a. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:29:23 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Getting quotas for user b1cf68007f18458b9824e056151f5c57 and project ed98064a134b4603bbf641f45988564a. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:29:24 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:29:24 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='79a1d055-ed0e-40c1-9f23-c5aea8d1f9fc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b0cc7840-90f7-4311-8c15-78c644bad569',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03750d10-be51-41e7-8ffe-78d0af572b24',volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:29:24 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-700658eb-155c-4e7b-a476-20bb82b4a825 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.106976 Apr 12 12:29:24 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 36/117] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 12:29:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 3109 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=18 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:24 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ed3facd5-0f96-45c8-b5e3-3b98c9153ebd tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 200 len: 1280 microversion: 2.32 time: 0.266269 Apr 12 12:29:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 40/118] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:29:24 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 12:29:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "name": "network-vif-plugged", "status": "completed", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] Creating event network-vif-plugged:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:29:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9076ad82-a8ad-47bb-a103-439da6157023 req-b5793798-ea9f-4d27-97ba-5968a450aac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042625 Apr 12 12:29:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 43/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1300903891", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "0fcb9046-707e-462c-937c-3ba5aebe64e8"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] validate_networks() for [('0fcb9046-707e-462c-937c-3ba5aebe64e8', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting quotas for project 466d2a494cf64002a98588909bdcd197. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting quotas for user 35727e3b48da4494808015e2b630a3f9 and project 466d2a494cf64002a98588909bdcd197. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:29:31 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:29:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a6fa54da-fc4c-477c-8025-80158307b0ae tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.817311 Apr 12 12:29:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 37/120] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:29:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:29:31 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f4cb92e4-6506-4523-93d0-5f6e752e437a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f4cb92e4-6506-4523-93d0-5f6e752e437a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:31 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-f4cb92e4-6506-4523-93d0-5f6e752e437a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f4cb92e4-6506-4523-93d0-5f6e752e437a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016" status: 200 len: 1213 microversion: 2.1 time: 0.072390 Apr 12 12:29:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 41/121] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:31 2023] GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] Creating event network-changed:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-6e561dcb-b8fe-4c89-b4d2-59d9f870f115 req-efc5151e-baba-42b3-a2f0-ccf8a6008e18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030102 Apr 12 12:29:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 44/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:32 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "name": "network-vif-plugged", "status": "completed", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] Creating event network-vif-plugged:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:29:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-fca90ae1-59de-4149-9d83-fa08f68248cc req-e6980fe4-b0e8-4ab3-941b-33e0f85eca0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Apr 12 12:29:33 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 38/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "c698ebb6-016a-4988-8c8a-7a75252a7944"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] Creating event network-changed:c698ebb6-016a-4988-8c8a-7a75252a7944 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d37eb6ff-a5df-4b02-a122-10a96464cb2d req-228de561-6e0e-49d8-9fe8-25c88cc0957a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034730 Apr 12 12:29:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "bb10902a-003e-4c1a-85a8-194f040a1ffb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] Creating event network-changed:bb10902a-003e-4c1a-85a8-194f040a1ffb for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-33a5779a-ab78-4ece-8a0c-ddc6638ac2d4 req-7c3fbb7d-d41f-4d2b-a149-a33046de69d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040733 Apr 12 12:29:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 45/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:38 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}, {"name": "network-changed", "server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Creating event network-changed:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] Creating event network-changed:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:29:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-871e12c1-3750-48a4-9d2d-61c3bd63299b req-4f051dda-e687-49a9-8567-2f01a1c50464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036019 Apr 12 12:29:38 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 39/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:38 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "name": "network-vif-plugged", "status": "completed", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] Creating event network-vif-plugged:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:29:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a4c9e88c-cf74-4f10-a18a-34548110105e req-71e1bcea-c96b-4a67-b829-d5eedc436fcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043585 Apr 12 12:29:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}, {"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Creating event network-changed:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] Creating event network-changed:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c6bab2aa-4865-4831-b00c-07c24089d687 req-410cea38-ad28-4665-816d-4da5a1f07363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064657 Apr 12 12:29:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 46/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:40 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:41 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "name": "network-vif-plugged", "status": "completed", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] Creating event network-vif-plugged:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:29:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-42f1bd48-576b-4448-8ea6-3c9f7205179d req-78b8bd09-3881-4a98-8d25-9b41731d7ccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042631 Apr 12 12:29:41 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 40/129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] Creating event network-changed:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-795216b8-d8c8-443a-ab5f-6c60fb412618 req-5d60ca38-7eea-48af-9a08-15a2f7fb19aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036330 Apr 12 12:29:42 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 47/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:42 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2991a85234e046698761e54b1f203861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c4688a3b0b429fb12d12ab7bd14e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:42 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d6ca4128-35cc-4763-95dc-58175cc96927 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8" status: 200 len: 1525 microversion: 2.1 time: 0.215775 Apr 12 12:29:42 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 44/131] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:42 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:43 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e3fb7903c94cd6a2a709ca0e133ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f3f538463546f9a0eab47df52e2f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-15f59724-d330-432a-b222-979369b72772 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 200 len: 1547 microversion: 2.1 time: 0.510616 Apr 12 12:29:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 41/132] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:29:43 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 1547 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:45 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:29:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-cb72bb43-be33-49cd-8cb0-e7d15c30da6e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 200 len: 1625 microversion: 2.49 time: 0.218491 Apr 12 12:29:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 48/133] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:29:45 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 1625 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 12:29:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] Creating event network-vif-plugged:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f27af70e-6260-4ab4-85cd-d3409afdc6b8 req-577917e9-7845-4aa4-903d-24e35fd39089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059559 Apr 12 12:29:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "c698ebb6-016a-4988-8c8a-7a75252a7944"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=18 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] Creating event network-vif-plugged:c698ebb6-016a-4988-8c8a-7a75252a7944 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e82a500f-0056-4d92-ba5f-acf546fa9e17 req-1c32039e-41ce-47e4-a4bf-df9fe6938562 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103797 Apr 12 12:29:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 42/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=16 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=29 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:29:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] Creating event network-vif-plugged:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-89853f93-38c5-4bd2-b032-c229b4fc28c4 req-3983b4cc-48f5-493e-bba9-7a996ba61149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038418 Apr 12 12:29:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 49/136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Creating event network-vif-plugged:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Creating event network-vif-plugged:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Creating event network-vif-plugged:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Creating event network-vif-plugged:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] Creating event network-vif-plugged:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f3657f77-d339-43fc-88ad-2f5e6aeaef8c req-93ac5df1-e258-4737-9c02-67fbc8bf547d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.041126 Apr 12 12:29:53 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:29:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "c698ebb6-016a-4988-8c8a-7a75252a7944"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bb10902a-003e-4c1a-85a8-194f040a1ffb"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bb10902a-003e-4c1a-85a8-194f040a1ffb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Creating event network-vif-plugged:c698ebb6-016a-4988-8c8a-7a75252a7944 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Creating event network-vif-plugged:bb10902a-003e-4c1a-85a8-194f040a1ffb for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] Creating event network-vif-plugged:bb10902a-003e-4c1a-85a8-194f040a1ffb for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-78d695a7-7ec7-4439-a0c1-a6c1fb3bc239 req-f4ddb68a-e7fb-4aa9-b5d5-e2295d41bec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046362 Apr 12 12:29:53 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 43/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:29:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:29:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:29:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:29:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:29:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Creating event network-vif-plugged:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Creating event network-vif-plugged:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] Creating event network-vif-plugged:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:29:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-816b4276-ebeb-4fd5-939e-701cd74b4023 req-f0a759bd-4c6e-4dcc-8e17-ef6fefff25af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.371407 Apr 12 12:29:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 50/139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:29:54 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=15 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:02 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2e50e62d-74a8-49d8-bc34-8f09c277e9b4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 200 len: 1378 microversion: 2.1 time: 0.222655 Apr 12 12:30:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 47/140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:01 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 1378 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:06 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:06 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:07 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid a4107f2d-88e4-4846-9ece-cb16ad7ecd02 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:30:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f01f03b9-8578-463e-aa6d-9b053265cdbc tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/action" status: 200 len: 32 microversion: 2.1 time: 0.520944 Apr 12 12:30:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 44/141] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:30:06 2023] POST /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02/action => generated 32 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:07 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e1d2130f-a4b1-4f8b-995b-bd0df2f9d177 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 200 len: 1510 microversion: 2.1 time: 0.185111 Apr 12 12:30:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 51/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:07 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:07 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-6a0a9144-f970-44e1-a87a-3634a478998b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: .version_select at 0x7fc95d72eb00>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1869203116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8n/tv/M6R4wuDM0jbUye1gml7maodQ+9g689zJJzJ3WkTrfUhAnJqMicn9hfAmFSezo1t5uVHloxtsKXdGPLhaCAAP9IYcYEBLi42ToHoaHRnJDijgZlZ0V9SGIdT9Ig=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:07 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-6a0a9144-f970-44e1-a87a-3634a478998b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting quotas for project c8ad4c8abb3447bd8ad5f5f2e95e2d78. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:30:07 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-6a0a9144-f970-44e1-a87a-3634a478998b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting quotas for user 2272654f6bbb4fb39b3c334c32d4688c and project c8ad4c8abb3447bd8ad5f5f2e95e2d78. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:30:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-6a0a9144-f970-44e1-a87a-3634a478998b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.292238 Apr 12 12:30:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 48/143] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:30:07 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-unplugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] Creating event network-vif-unplugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:30:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3312ecc8-0e97-4c24-a499-14ec74077852 req-dff45ecc-f0fa-401c-8e09-b8f80bd4fbb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031543 Apr 12 12:30:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 45/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-651340607", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1869203116", "security_groups": [{"name": "tempest-secgroup-smoke-771441331"}], "networks": [{"uuid": "cba3e8fe-24d8-4128-b9b8-4087ab3a4407"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] validate_networks() for [('cba3e8fe-24d8-4128-b9b8-4087ab3a4407', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting quotas for project c8ad4c8abb3447bd8ad5f5f2e95e2d78. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Getting quotas for user 2272654f6bbb4fb39b3c334c32d4688c and project c8ad4c8abb3447bd8ad5f5f2e95e2d78. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:30:09 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:30:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a4026fb0-f2bf-4885-b1e4-89b8857681dc tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.613680 Apr 12 12:30:09 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 52/145] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:30:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:30:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-57eab29f-2b2e-4ed3-8fbf-296097790e87 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:09 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-57eab29f-2b2e-4ed3-8fbf-296097790e87 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:09 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-57eab29f-2b2e-4ed3-8fbf-296097790e87 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272654f6bbb4fb39b3c334c32d4688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ad4c8abb3447bd8ad5f5f2e95e2d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-57eab29f-2b2e-4ed3-8fbf-296097790e87 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 200 len: 1256 microversion: 2.1 time: 0.072419 Apr 12 12:30:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 49/146] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:09 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 1256 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:30:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e8940c44-1970-43be-8d0a-8b46fa1970e7 req-849695f8-caa9-4425-9225-7e802d03823e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053751 Apr 12 12:30:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 46/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:12 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}, {"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:30:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:30:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1f9aba5a-2979-4f67-bd3e-af9f7325b3e9 req-ce94be56-8b4e-488c-8ca5-4961ed35b86a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035098 Apr 12 12:30:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 53/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=5 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] Creating event network-changed:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:30:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-6356ab6a-04a1-4532-b895-87da3eb1db57 req-726c4ff6-82ff-4790-ade9-bfb9d81b9852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030163 Apr 12 12:30:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 50/149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:15 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:15 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:15 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ffe5d876-f1bc-48b4-9c53-01cfbc59ac65 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 200 len: 2824 microversion: 2.32 time: 0.390904 Apr 12 12:30:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 47/150] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:30:14 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 2824 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "149aa9b1-4712-4377-899a-30c28b5a826c"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-785001ce-324a-4c38-a20c-4c8fb525befd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550227 Apr 12 12:30:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 54/151] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:30:15 2023] POST /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}, {"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Creating event network-vif-plugged:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:30:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] Creating event network-vif-plugged:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:30:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-3636939a-8a6a-4c05-b4c4-1da0106d9500 req-b6919c3a-3f6b-4f1e-b75f-3cc6f0cafbdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030229 Apr 12 12:30:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-0a9428b6-c35f-40db-b9ea-b71e65f76567 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.088880 Apr 12 12:30:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 48/153] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:30:19 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] Creating event network-changed:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:30:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-8d13544c-651d-47d5-872c-df0bbef31dfe req-69ed86a4-dd09-4445-b40d-299c878e0c3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059185 Apr 12 12:30:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 55/154] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:20 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fe3a1318-8f71-47ba-80ad-01ab0e855ad0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1541 microversion: 2.1 time: 0.244039 Apr 12 12:30:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:20 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1541 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:21 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4111e93d-5c4c-4f8e-b141-a76661064d05 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1541 microversion: 2.1 time: 0.233901 Apr 12 12:30:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 49/156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:20 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1541 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:22 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0f6ea3c3-14bd-4a98-85e1-cb0ac63d0e24 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016" status: 200 len: 1495 microversion: 2.1 time: 0.146906 Apr 12 12:30:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 56/157] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:22 2023] GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 => generated 1495 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-24be86d2-5d84-4e69-b57b-681df00c9ce7 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.135959 Apr 12 12:30:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 53/158] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:30:22 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-interface => generated 282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:30:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a36dbf72-6b22-4378-9dcb-1399d153d164 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 204 len: 0 microversion: 2.1 time: 0.145756 Apr 12 12:30:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 50/159] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:30:23 2023] DELETE /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] Creating event network-changed:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:30:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-6d89e6a9-df14-4150-b3c8-7b8c37ad848b req-55137e77-a4d3-4c3d-a1d1-39c39832cc8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042605 Apr 12 12:30:23 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 57/160] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2055195241"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:23 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d432191ea141a58407f7b21d077b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8ee9df3d2043fb818cc565b1d3e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:23 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-bfb86072-ba4b-43de-a725-18dcc1d46fb9 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 200 len: 1543 microversion: 2.1 time: 0.225215 Apr 12 12:30:23 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:23 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 1543 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:24 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "name": "network-vif-unplugged", "status": "completed", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] Creating event network-vif-unplugged:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:30:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-04140b14-015a-4fa7-abb7-96c6d632c1f5 req-2de537c1-65f6-4e8d-a619-ce28b2cee09a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027700 Apr 12 12:30:24 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 58/162] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:24 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-aeb7cf0e-86c1-45fd-81cb-e8d6442c5263 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action" status: 202 len: 0 microversion: 2.1 time: 1.029974 Apr 12 12:30:24 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 51/163] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:30:23 2023] POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 12:30:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9ef510c0-995d-4c7a-9351-5fca0d70662a tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '.version_select at 0x7fc95d72e5f0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9ef510c0-995d-4c7a-9351-5fca0d70662a tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce" status: 200 len: 1611 microversion: 2.1 time: 0.057984 Apr 12 12:30:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 12:30:24 2023] GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce => generated 1611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "name": "network-vif-deleted", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] Creating event network-vif-deleted:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:30:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f44ff3dd-9dd7-462b-bee6-471110e67958 req-c93228bd-b501-4d6e-a234-e293259a81ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039920 Apr 12 12:30:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 59/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:26 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a054fbb-bfb4-40fa-8a03-a0c201df6857", "name": "network-vif-plugged", "status": "completed", "tag": "bea9db47-d43e-4df8-a5f2-e934e855cfa5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:26 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] Creating event network-vif-plugged:bea9db47-d43e-4df8-a5f2-e934e855cfa5 for instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 on user Apr 12 12:30:26 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-2733a7a9-b4b6-45d9-bd10-7c9873db17b2 req-213dd09d-29ca-4e6a-91d8-7743cc26f80f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052944 Apr 12 12:30:26 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 52/166] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=20 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:42 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-36b4737a-cd89-4a3e-b174-56da42612369 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104128 Apr 12 12:30:42 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:30:42 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] Creating event network-changed:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:30:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-57945fad-6866-40b1-b8a8-ae233083ea39 req-0f7c9e91-97e4-464d-ad9e-dc69a5d092f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047845 Apr 12 12:30:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 53/168] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e311de8d-6a47-423c-a299-4ce16f4d10f1"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5a7e1203-4736-455f-88df-c80d9eab0654 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.127844 Apr 12 12:30:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 60/169] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:30:43 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-interface => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7fb00ddc-7011-4290-9876-accb09688f59 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "POST /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317607 Apr 12 12:30:44 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 57/170] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:30:43 2023] POST /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:44 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:44 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] Creating event network-changed:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:30:44 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3e2fc118-ba46-4b04-be88-c329299c270a req-f3666317-4987-4fbb-9c16-341f91df1c4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035527 Apr 12 12:30:44 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 54/171] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6732d4a5-53ff-4bcf-8e2c-78ad7d3694c3 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.089882 Apr 12 12:30:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 61/172] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:30:45 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface => generated 282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43cc7387-42a1-4c71-bb86-64ec15a30ec9"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] Creating event network-changed:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:30:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-caffee29-90b1-4d14-a2d6-e457b126f018 req-591c75a2-a54e-4070-b6a7-6fc4cd2e074f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035054 Apr 12 12:30:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 55/173] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3c76a41b-c2c5-4d0f-a95d-712a98192f9b tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421586 Apr 12 12:30:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 58/174] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:30:46 2023] POST /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:46 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7fb3e89a-0fef-4e00-9e19-373a34ccc6f7 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 200 len: 1625 microversion: 2.49 time: 0.179753 Apr 12 12:30:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 62/175] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:30:46 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 1625 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "fa236fb1-e347-4c0e-bb34-51cf6d7dd7f9", "tag": "nic-tag"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] Creating event network-changed:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:30:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-486614ad-66ef-4acf-a81e-bed498079b6f req-3f2da9f0-f7b7-4d63-bb39-8326f48edf99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043352 Apr 12 12:30:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b8fb7c64-ec43-49a5-8b63-afa81e66d727 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "POST /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.997989 Apr 12 12:30:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 56/177] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 12:30:46 2023] POST /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface => generated 283 bytes in 3999 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "690fc6dc-8836-419f-8039-0584b2561e4b", "tag": "volume-tag"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-929fca44-870f-4b4b-9025-d290e89069e4 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "POST /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.325924 Apr 12 12:30:51 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 63/178] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 12:30:50 2023] POST /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:30:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}, {"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Creating event network-vif-plugged:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:30:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] Creating event network-vif-plugged:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:30:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-911c9efe-b664-4dfe-879f-aca8d6cc0a8f req-aeb969a3-c21a-467a-8f6c-1ef3dd82258e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033126 Apr 12 12:30:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 60/179] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "173c47c1-0f4e-43d9-b90f-c6c458b25d5b"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-34d2bf2a-4fb3-496b-9d03-4b1a7ebe29e0 tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/e311de8d-6a47-423c-a299-4ce16f4d10f1" status: 202 len: 0 microversion: 2.1 time: 0.440336 Apr 12 12:30:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 57/180] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 12:30:51 2023] PUT /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/e311de8d-6a47-423c-a299-4ce16f4d10f1 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-da03936d-a735-4b2b-816a-b895115c09b9 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Apr 12 12:30:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 64/181] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:30:54 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:54 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lazy-loading 'services' on Instance uuid 2f3ff25a-522c-431b-a177-85177401c7a9 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:30:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2e8e1603-81f9-4b47-8459-1385a8534016 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments/43cc7387-42a1-4c71-bb86-64ec15a30ec9" status: 202 len: 0 microversion: 2.1 time: 0.285369 Apr 12 12:30:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:30:54 2023] DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments/43cc7387-42a1-4c71-bb86-64ec15a30ec9 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-29df3cac-ef2f-4439-bd7f-37a690a02334 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051240 Apr 12 12:30:57 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 58/183] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:30:56 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4133cccf-0555-4bd6-8a50-1f9989f58512 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046324 Apr 12 12:30:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 65/184] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:30:57 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:30:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-6c349f92-85f0-4170-a1f0-8b9225b4221f tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 204 len: 0 microversion: 2.1 time: 0.180531 Apr 12 12:30:57 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:30:57 2023] DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e3fb7903c94cd6a2a709ca0e133ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f3f538463546f9a0eab47df52e2f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:57 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-39540082-0259-4e29-b204-1682d3fae629 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 200 len: 1671 microversion: 2.1 time: 0.197715 Apr 12 12:30:57 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 59/186] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:57 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "name": "network-vif-unplugged", "status": "completed", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] Creating event network-vif-unplugged:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-68bd7ea9-44a7-4e73-9ae5-8c723dec7fc7 req-94464d23-7451-4869-b2e3-5fa2d063a682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030530 Apr 12 12:30:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 66/187] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:57 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:30:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-16483f1b-00b8-439b-93d7-0b4ade146aed tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 200 len: 1490 microversion: 2.1 time: 0.222471 Apr 12 12:30:57 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:30:57 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 1490 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:58 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lazy-loading 'services' on Instance uuid 79bee3fe-3300-4a28-b079-1bafaa1033c4 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:30:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7cc358f7-6581-4e1e-bb8b-dc1fb6250d7e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments/690fc6dc-8836-419f-8039-0584b2561e4b" status: 202 len: 0 microversion: 2.49 time: 0.228167 Apr 12 12:30:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 60/189] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 12:30:58 2023] DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments/690fc6dc-8836-419f-8039-0584b2561e4b => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:30:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "name": "network-vif-plugged", "status": "completed", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:59 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3ff25a-522c-431b-a177-85177401c7a9", "name": "network-vif-deleted", "tag": "7db9ebe7-8544-46eb-8d75-929d0422278f"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:30:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:30:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:30:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:30:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] Creating event network-vif-plugged:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:30:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-8ee533b7-69df-4e6e-804f-144a8bb28fff req-c2dc18a5-bc35-44b4-80c5-cda9f844cd27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067873 Apr 12 12:30:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:30:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] Creating event network-vif-deleted:7db9ebe7-8544-46eb-8d75-929d0422278f for instance 2f3ff25a-522c-431b-a177-85177401c7a9 on user Apr 12 12:30:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-3b2879ab-a98b-4d45-813a-d22cc7e72a3b req-e6425304-fc49-46cf-8120-d7053439f087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076316 Apr 12 12:30:59 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 67/191] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:30:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:00 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272654f6bbb4fb39b3c334c32d4688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ad4c8abb3447bd8ad5f5f2e95e2d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-81471ccd-c330-4d28-81a5-b4729f3e3637 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 200 len: 1566 microversion: 2.1 time: 0.190612 Apr 12 12:31:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 61/192] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:00 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d2140541-89c4-4b95-832b-00673617cfc2 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface/8438a9df-803e-44da-a2b6-b394bd23fbb1" status: 202 len: 0 microversion: 2.49 time: 0.054186 Apr 12 12:31:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 12:31:01 2023] DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-interface/8438a9df-803e-44da-a2b6-b394bd23fbb1 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-62b41900-81a2-4b13-ac0b-78bc20ba4c63 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2" status: 200 len: 474 microversion: 2.49 time: 0.338484 Apr 12 12:31:02 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 68/194] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 12:31:01 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2 => generated 474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-6b31dfdc-39a3-4211-a132-d9fb126909a5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 200 len: 1378 microversion: 2.1 time: 0.359523 Apr 12 12:31:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 62/195] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:02 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 1378 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-unplugged", "status": "completed", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] Creating event network-vif-unplugged:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-70fc945e-a229-481f-9f48-5e6c49ca2df0 req-5910eaab-ae07-4b80-90d4-9ee1d2679ac4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049059 Apr 12 12:31:02 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 69/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:02 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fc00ab00-dd01-45c3-80bb-ab8f327dd209 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 200 len: 1378 microversion: 2.1 time: 0.234414 Apr 12 12:31:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:02 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 1378 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:02 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:31:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-bf75ee7e-ad9b-49e0-a765-0f4fcfe26ea5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 204 len: 0 microversion: 2.1 time: 0.131501 Apr 12 12:31:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 63/198] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:31:02 2023] DELETE /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:03 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d533a4af-516b-43ad-9a0a-08726c20661e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 200 len: 1384 microversion: 2.1 time: 0.271338 Apr 12 12:31:03 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 70/199] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:03 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 1384 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "name": "network-vif-unplugged", "status": "completed", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] Creating event network-vif-unplugged:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:31:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-62c92f08-33fc-4b9e-b64c-1dc0f573caee req-725986c9-a129-43e7-a8de-1ea4fd2e4c18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028048 Apr 12 12:31:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}, {"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-deleted", "tag": "8438a9df-803e-44da-a2b6-b394bd23fbb1"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Creating event network-vif-plugged:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] Creating event network-vif-deleted:8438a9df-803e-44da-a2b6-b394bd23fbb1 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-34efa699-691a-45b8-ada3-dc4edf4324e1 req-a4892eb0-ac2a-465c-9ddb-b1c590db8374 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042934 Apr 12 12:31:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 64/201] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-49de25ab-1a0e-4e3f-b2a2-28403d270171 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Apr 12 12:31:05 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 71/202] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:05 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-106d9714-fe6b-4038-b652-6ed1320230e2 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Apr 12 12:31:05 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:05 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e311de8d-6a47-423c-a299-4ce16f4d10f1"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "name": "network-vif-plugged", "status": "completed", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:05 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] Creating event network-vif-plugged:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:31:05 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-cc1626e0-c3fa-4106-9901-d44cc521d8b6 req-063fa9b7-910b-499a-b369-c31445f30351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050040 Apr 12 12:31:05 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 72/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-8fd2e00d-ac95-4f78-8441-7783b78b2a9f tempest-TestVolumeSwap-160182401 tempest-TestVolumeSwap-160182401-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/173c47c1-0f4e-43d9-b90f-c6c458b25d5b" status: 202 len: 0 microversion: 2.1 time: 0.285781 Apr 12 12:31:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 65/205] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 12:31:05 2023] PUT /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/173c47c1-0f4e-43d9-b90f-c6c458b25d5b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:31:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64589bd5-2688-4224-ba3e-8a26f9ffafaf", "name": "network-vif-deleted", "tag": "a3d4da82-f4ab-410c-8692-f14de0e43ef5"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] Creating event network-vif-deleted:a3d4da82-f4ab-410c-8692-f14de0e43ef5 for instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf on user Apr 12 12:31:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-6304c6a2-07d6-4af6-9c7b-0fb085d29b57 req-993b5d03-4540-4ec6-871c-8b6b199575cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038127 Apr 12 12:31:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:11 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4f3df0f8-abf6-4904-bfe6-6d652724011e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1660 microversion: 2.1 time: 0.143091 Apr 12 12:31:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 73/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:11 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1660 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5cbbe951-65cd-488a-8ce2-01146e34c4ca tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1660 microversion: 2.1 time: 0.144785 Apr 12 12:31:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 66/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:11 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1660 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] HTTP exception thrown: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Request method failure captured: Apr 12 12:31:14 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 HTTP/1.1 Apr 12 12:31:14 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:31:14 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:31:14 user devstack@n-api.service[61615]: Connection: close Apr 12 12:31:14 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:31:14 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:31:14 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:31:14 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:31:14 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPl_17f5kU0EN_B6h8HK3lO1bfQ1qweaI3Qb3CRfVjeWKd_Kqjs-7mWc4qYah5qNWM-cKxJAHaRRzBrfkPIMZz8jRnwGaGcOklQ0DCwEzdxilkIFd77hZBo5azvbWGogD_dp9wzeEqxryJ2xuR3cRSqfv7vivTUWXUjukbQPvS-XkU Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Project-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Project-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Tenant: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Tenant-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-User: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:14 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:31:14 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:31:14 user devstack@n-api.service[61615]: X-User-Id: f0d432191ea141a58407f7b21d077b58 Apr 12 12:31:14 user devstack@n-api.service[61615]: X-User-Name: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:14 user devstack@n-api.service[61615]: method: > Apr 12 12:31:14 user devstack@n-api.service[61615]: exception: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61615]: action_args: {'id': '5a054fbb-bfb4-40fa-8a03-a0c201df6857'} Apr 12 12:31:14 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Returning 404 to user: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1bc1833d-5c53-4014-8594-cc6e5f9c9719 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 404 len: 111 microversion: 2.1 time: 0.044919 Apr 12 12:31:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:14 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=29 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:14 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] HTTP exception thrown: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Request method failure captured: Apr 12 12:31:14 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857/os-volume_attachments HTTP/1.1 Apr 12 12:31:14 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:31:14 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:31:14 user devstack@n-api.service[61614]: Connection: close Apr 12 12:31:14 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:31:14 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:31:14 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:31:14 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:31:14 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPl_17f5kU0EN_B6h8HK3lO1bfQ1qweaI3Qb3CRfVjeWKd_Kqjs-7mWc4qYah5qNWM-cKxJAHaRRzBrfkPIMZz8jRnwGaGcOklQ0DCwEzdxilkIFd77hZBo5azvbWGogD_dp9wzeEqxryJ2xuR3cRSqfv7vivTUWXUjukbQPvS-XkU Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Project-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Project-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Tenant: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Tenant-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-User: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:14 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:31:14 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:31:14 user devstack@n-api.service[61614]: X-User-Id: f0d432191ea141a58407f7b21d077b58 Apr 12 12:31:14 user devstack@n-api.service[61614]: X-User-Name: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:14 user devstack@n-api.service[61614]: method: > Apr 12 12:31:14 user devstack@n-api.service[61614]: exception: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61614]: action_args: {'server_id': '5a054fbb-bfb4-40fa-8a03-a0c201df6857'} Apr 12 12:31:14 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:14 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Returning 404 to user: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:14 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-176c2f71-d843-4cb2-b7e7-ab5bd0421811 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050327 Apr 12 12:31:14 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 74/210] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:14 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d722199f-abbd-44ff-ac4d-f6e76e1ba209 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '.version_select at 0x7fc95d5043a0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d722199f-abbd-44ff-ac4d-f6e76e1ba209 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.058955 Apr 12 12:31:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 67/211] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 12:31:14 2023] GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce => generated 1725 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4841edf3-8a0c-4bae-a787-dd30249a3fd2 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '.version_select at 0x7fc95d42e9e0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4841edf3-8a0c-4bae-a787-dd30249a3fd2 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.088519 Apr 12 12:31:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 12:31:15 2023] GET /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce => generated 1725 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-57df4cca-3577-4690-bb5d-eb0f47824417 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.195892 Apr 12 12:31:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 68/213] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:31:15 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720/os-interface => generated 1828 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:31:15 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-796bbf25-cd19-4034-874c-63b192ef07e8 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1671 microversion: 2.1 time: 0.610666 Apr 12 12:31:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 75/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:15 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1671 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] Creating event network-changed:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-3a202011-9ad7-4d64-a8a2-3b58a6041dda req-f6a295f3-96ee-4ad7-9a51-d01de70f6711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038972 Apr 12 12:31:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] HTTP exception thrown: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Request method failure captured: Apr 12 12:31:16 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 HTTP/1.1 Apr 12 12:31:16 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:31:16 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:31:16 user devstack@n-api.service[61614]: Connection: close Apr 12 12:31:16 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:31:16 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:31:16 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:31:16 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:31:16 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPl_17f5kU0EN_B6h8HK3lO1bfQ1qweaI3Qb3CRfVjeWKd_Kqjs-7mWc4qYah5qNWM-cKxJAHaRRzBrfkPIMZz8jRnwGaGcOklQ0DCwEzdxilkIFd77hZBo5azvbWGogD_dp9wzeEqxryJ2xuR3cRSqfv7vivTUWXUjukbQPvS-XkU Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Project-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Project-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Tenant: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Tenant-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-User: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:16 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:31:16 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:31:16 user devstack@n-api.service[61614]: X-User-Id: f0d432191ea141a58407f7b21d077b58 Apr 12 12:31:16 user devstack@n-api.service[61614]: X-User-Name: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:16 user devstack@n-api.service[61614]: method: > Apr 12 12:31:16 user devstack@n-api.service[61614]: exception: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61614]: action_args: {'id': '5a054fbb-bfb4-40fa-8a03-a0c201df6857'} Apr 12 12:31:16 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Returning 404 to user: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0388655b-f090-43c2-83b5-50432d444388 tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 404 len: 111 microversion: 2.1 time: 0.035393 Apr 12 12:31:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 76/216] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:31:16 2023] DELETE /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] [instance: 5a054fbb-bfb4-40fa-8a03-a0c201df6857] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] HTTP exception thrown: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Request method failure captured: Apr 12 12:31:16 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 HTTP/1.1 Apr 12 12:31:16 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:31:16 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:31:16 user devstack@n-api.service[61615]: Connection: close Apr 12 12:31:16 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:31:16 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:31:16 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:31:16 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:31:16 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPl_17f5kU0EN_B6h8HK3lO1bfQ1qweaI3Qb3CRfVjeWKd_Kqjs-7mWc4qYah5qNWM-cKxJAHaRRzBrfkPIMZz8jRnwGaGcOklQ0DCwEzdxilkIFd77hZBo5azvbWGogD_dp9wzeEqxryJ2xuR3cRSqfv7vivTUWXUjukbQPvS-XkU Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Project-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Project-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c8ee9df3d2043fb818cc565b1d3e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Tenant: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Tenant-Id: 5c8ee9df3d2043fb818cc565b1d3e9d2 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075182425 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-User: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:16 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:31:16 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:31:16 user devstack@n-api.service[61615]: X-User-Id: f0d432191ea141a58407f7b21d077b58 Apr 12 12:31:16 user devstack@n-api.service[61615]: X-User-Name: tempest-DeleteServersTestJSON-2075182425-project-member Apr 12 12:31:16 user devstack@n-api.service[61615]: method: > Apr 12 12:31:16 user devstack@n-api.service[61615]: exception: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61615]: action_args: {'id': '5a054fbb-bfb4-40fa-8a03-a0c201df6857'} Apr 12 12:31:16 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. Apr 12 12:31:16 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] Returning 404 to user: Instance 5a054fbb-bfb4-40fa-8a03-a0c201df6857 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-37e4d40c-5580-499a-9419-94605400eecd tempest-DeleteServersTestJSON-2075182425 tempest-DeleteServersTestJSON-2075182425-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857" status: 404 len: 111 microversion: 2.1 time: 0.031260 Apr 12 12:31:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:16 2023] GET /compute/v2.1/servers/5a054fbb-bfb4-40fa-8a03-a0c201df6857 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:16 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a2bc655e-f803-4ebf-8326-0f0a3262f2c3 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 200 len: 2824 microversion: 2.32 time: 0.316018 Apr 12 12:31:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 69/218] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:31:16 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 2824 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ec34d404-b9ed-43de-8f4c-c7ce7dcb2530 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.138434 Apr 12 12:31:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 77/219] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:31:16 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720/os-interface => generated 1828 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:31:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5237d293-ef8a-42c5-8b4e-e425eac00ee8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 204 len: 0 microversion: 2.32 time: 0.142881 Apr 12 12:31:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 74/220] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:31:18 2023] DELETE /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1cf68007f18458b9824e056151f5c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed98064a134b4603bbf641f45988564a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c8f95bf6-875a-4c65-badd-235a50e5fc21 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 200 len: 2948 microversion: 2.32 time: 0.226914 Apr 12 12:31:18 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 70/221] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:31:18 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 2948 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-16949d3c-d38a-4c78-90db-8978bc69bc3c tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058548 Apr 12 12:31:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 78/222] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:18 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1dbca134-bbd6-4a7e-aa94-09f203b9a9a8 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054614 Apr 12 12:31:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:18 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:18 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lazy-loading 'services' on Instance uuid 540a69c0-488f-40cb-bdde-3e410029d4c8 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] Creating event network-vif-unplugged:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-5f869ca3-fa16-487e-af19-c72b3aba15d9 req-1fb3a3c6-6444-4081-856e-832c3123b230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036169 Apr 12 12:31:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 79/224] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-edb2f55f-3fae-440f-b6b3-3bb9d7f0a757 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/e311de8d-6a47-423c-a299-4ce16f4d10f1" status: 202 len: 0 microversion: 2.1 time: 0.190120 Apr 12 12:31:18 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 71/225] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:31:18 2023] DELETE /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments/e311de8d-6a47-423c-a299-4ce16f4d10f1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "c698ebb6-016a-4988-8c8a-7a75252a7944"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a762fe0a-bbc5-47bf-9883-0fb387947610 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055684 Apr 12 12:31:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:31:18 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] Creating event network-vif-unplugged:c698ebb6-016a-4988-8c8a-7a75252a7944 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-66bfabcf-72e0-46b6-ac3d-2f8cd3bf5d72 req-51fc447c-897a-4458-bab5-97b1e7282004 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060818 Apr 12 12:31:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 80/227] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] Creating event network-vif-unplugged:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-66faac36-1207-41a1-87a0-002b2c49f229 req-52d336ce-36f1-461a-b8ab-5c20c4b3c0bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048679 Apr 12 12:31:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 72/228] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Creating event network-vif-plugged:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Creating event network-vif-unplugged:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Creating event network-vif-plugged:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Creating event network-vif-unplugged:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] Creating event network-vif-plugged:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-96552b00-33f6-4c99-8b14-9b081d83e70a req-05b78884-47d5-4f47-961f-d1acdd38e9df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.036015 Apr 12 12:31:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:20 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:21 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "c698ebb6-016a-4988-8c8a-7a75252a7944"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "bb10902a-003e-4c1a-85a8-194f040a1ffb"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bb10902a-003e-4c1a-85a8-194f040a1ffb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Creating event network-vif-plugged:c698ebb6-016a-4988-8c8a-7a75252a7944 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Creating event network-vif-unplugged:bb10902a-003e-4c1a-85a8-194f040a1ffb for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] Creating event network-vif-plugged:bb10902a-003e-4c1a-85a8-194f040a1ffb for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9ff01ed6-4278-4f59-b47a-e06c9c19400f req-2d29326e-3307-4b81-af87-61441d4f60e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035740 Apr 12 12:31:21 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 81/230] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-unplugged", "status": "completed", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-plugged", "status": "completed", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Creating event network-vif-plugged:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Creating event network-vif-unplugged:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] Creating event network-vif-plugged:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-098ac6bf-fd4e-4e4a-9891-dad33da7691d req-fb995cf2-8518-4ef6-b8ca-ef2808f96217 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040535 Apr 12 12:31:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 73/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2314b64-00af-4289-aef2-e4adeec9da1f", "device": "/dev/vdb"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2c599635-4ac8-4bbb-94d6-c9b9482f0c77 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "POST /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268213 Apr 12 12:31:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 78/232] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:31:22 2023] POST /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-deleted", "tag": "6f2ec393-bb3c-4986-bd50-44ae9a7147b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] Creating event network-vif-deleted:6f2ec393-bb3c-4986-bd50-44ae9a7147b0 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-4ce9467e-029f-4f88-beca-c91b71dde896 req-a3e38f33-b584-4c74-beab-6d8d6bb69905 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Apr 12 12:31:23 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 82/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:25 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-deleted", "tag": "bf6a7707-9d55-46b2-8738-06505013048b"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-deleted", "tag": "e9757213-2bc0-46a5-bffa-3b503c65ecc2"}, {"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-deleted", "tag": "389d5d9e-e5fc-48f1-b443-b04d08ec6181"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:25 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Creating event network-vif-deleted:bf6a7707-9d55-46b2-8738-06505013048b for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:25 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Creating event network-vif-deleted:e9757213-2bc0-46a5-bffa-3b503c65ecc2 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:25 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] Creating event network-vif-deleted:389d5d9e-e5fc-48f1-b443-b04d08ec6181 for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:25 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-f8114151-65fb-4844-875a-9c28a0268d26 req-35778702-0a63-44e7-9dd9-566853ebd5e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048608 Apr 12 12:31:25 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 74/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:31:27 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8867363-6e36-4b34-9cc1-f30fbc572720", "name": "network-vif-deleted", "tag": "93bb6ab6-63a2-421a-b331-92c957f29f5a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:27 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] Creating event network-vif-deleted:93bb6ab6-63a2-421a-b331-92c957f29f5a for instance d8867363-6e36-4b34-9cc1-f30fbc572720 on user Apr 12 12:31:27 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-50945227-a530-475e-b8d6-37f4c28dd86f req-c0708569-c610-408b-abea-4173d26f1e07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Apr 12 12:31:27 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 79/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=17 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=27 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:43 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'services' on Instance uuid 651d5c05-2d02-450f-a33c-fbd9b3109016 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:31:44 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-be5fc4d0-1d91-4000-bd39-f1d548e7dafc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016/os-volume_attachments/f2314b64-00af-4289-aef2-e4adeec9da1f" status: 202 len: 0 microversion: 2.1 time: 0.302357 Apr 12 12:31:44 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 83/236] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:31:43 2023] DELETE /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016/os-volume_attachments/f2314b64-00af-4289-aef2-e4adeec9da1f => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=13 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:44 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:31:44 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b55f75dc-c5e3-44a9-97cd-dfc3dbf07c54 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016" status: 204 len: 0 microversion: 2.1 time: 0.162735 Apr 12 12:31:44 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 75/237] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:31:44 2023] DELETE /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:44 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-79ddfadb-de68-4783-a520-ea73d11706d7 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016" status: 200 len: 1547 microversion: 2.1 time: 0.187903 Apr 12 12:31:44 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:44 2023] GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "name": "network-vif-unplugged", "status": "completed", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] Creating event network-vif-unplugged:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:31:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-17fea41d-ffc2-455d-a0e6-c6a814ffe9ac req-ec57337d-aabd-4a36-9fd4-e2e83281b311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034244 Apr 12 12:31:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 84/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:47 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "name": "network-vif-deleted", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:47 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] Creating event network-vif-deleted:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:31:47 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-73ac1c48-86f4-49d8-b356-f88f71577f0d req-72166120-ce38-4f36-b98e-0bf952bea4bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044190 Apr 12 12:31:47 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 76/240] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] HTTP exception thrown: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Request method failure captured: Apr 12 12:31:47 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 HTTP/1.1 Apr 12 12:31:47 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:31:47 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:31:47 user devstack@n-api.service[61615]: Connection: close Apr 12 12:31:47 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:31:47 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:31:47 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:31:47 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:31:47 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPiXNx4HIwx8Zbnzc3F_qzA9lIusaN7B1X2YNN2JszPbikV_WpuZql6iOTofmcBDbC_LdI_V6asfnP-t8zTuIohiV1GoWsm-UrG1dMx4gkqY0vp8KM2U4czRnvr7xgrJyeMrwjJRo-U4HYJL8jBlzYernW68zqIfm1tpFM4NEgm-qY Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Project-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Tenant-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-User: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:47 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:31:47 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:31:47 user devstack@n-api.service[61615]: X-User-Id: 66e3fb7903c94cd6a2a709ca0e133ce2 Apr 12 12:31:47 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:47 user devstack@n-api.service[61615]: method: > Apr 12 12:31:47 user devstack@n-api.service[61615]: exception: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:47 user devstack@n-api.service[61615]: action_args: {'id': '2f3ff25a-522c-431b-a177-85177401c7a9'} Apr 12 12:31:47 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:47 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Returning 404 to user: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-647de905-a1c1-4001-8e3a-05eac40b7943 tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 404 len: 111 microversion: 2.1 time: 0.032304 Apr 12 12:31:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:47 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:47 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e59f2425-59d0-44ab-8908-d1a0b969dc9d tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '.version_select at 0x7fc95d5ab880>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e59f2425-59d0-44ab-8908-d1a0b969dc9d tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817895902" status: 202 len: 0 microversion: 2.1 time: 0.048196 Apr 12 12:31:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 85/242] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 12:31:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817895902 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:31:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651d5c05-2d02-450f-a33c-fbd9b3109016", "name": "network-vif-plugged", "status": "completed", "tag": "b8a991df-6886-4036-a382-49898be6fd25"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] Creating event network-vif-plugged:b8a991df-6886-4036-a382-49898be6fd25 for instance 651d5c05-2d02-450f-a33c-fbd9b3109016 on user Apr 12 12:31:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-75b93b91-bd7f-4378-94e4-ffdafe59f78c req-2e942903-229c-4c08-9a30-81958348ca91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033984 Apr 12 12:31:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 77/243] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:48 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-487067793", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:48 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] validate_networks() for None {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Getting quotas for project 9cc629696bdf4ed2bc9da7e20e8102fb. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Getting quotas for user ddeb0b1b08ba4cbcb08705c49517f43f and project 9cc629696bdf4ed2bc9da7e20e8102fb. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:31:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:31:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-45a16ffa-c05c-4fc3-b1b5-ffbbb565d415 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.443353 Apr 12 12:31:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:31:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:31:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e60584fc-81a4-4f6d-aed7-dc6a661a2fbc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e60584fc-81a4-4f6d-aed7-dc6a661a2fbc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:49 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e60584fc-81a4-4f6d-aed7-dc6a661a2fbc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeb0b1b08ba4cbcb08705c49517f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc629696bdf4ed2bc9da7e20e8102fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e60584fc-81a4-4f6d-aed7-dc6a661a2fbc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4" status: 200 len: 1208 microversion: 2.1 time: 0.067292 Apr 12 12:31:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 86/245] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:49 2023] GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] HTTP exception thrown: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Request method failure captured: Apr 12 12:31:50 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 HTTP/1.1 Apr 12 12:31:50 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:31:50 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:31:50 user devstack@n-api.service[61616]: Connection: close Apr 12 12:31:50 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:31:50 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:31:50 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:31:50 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:31:50 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPiXNx4HIwx8Zbnzc3F_qzA9lIusaN7B1X2YNN2JszPbikV_WpuZql6iOTofmcBDbC_LdI_V6asfnP-t8zTuIohiV1GoWsm-UrG1dMx4gkqY0vp8KM2U4czRnvr7xgrJyeMrwjJRo-U4HYJL8jBlzYernW68zqIfm1tpFM4NEgm-qY Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Project-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Tenant-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-User: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:50 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:31:50 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:31:50 user devstack@n-api.service[61616]: X-User-Id: 66e3fb7903c94cd6a2a709ca0e133ce2 Apr 12 12:31:50 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:50 user devstack@n-api.service[61616]: method: > Apr 12 12:31:50 user devstack@n-api.service[61616]: exception: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61616]: action_args: {'id': '2f3ff25a-522c-431b-a177-85177401c7a9'} Apr 12 12:31:50 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Returning 404 to user: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-832b48be-39a2-4ca9-b10b-be0383c435ee tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 404 len: 111 microversion: 2.1 time: 0.042234 Apr 12 12:31:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 78/246] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:31:50 2023] DELETE /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] [instance: 2f3ff25a-522c-431b-a177-85177401c7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] HTTP exception thrown: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Request method failure captured: Apr 12 12:31:50 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 HTTP/1.1 Apr 12 12:31:50 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:31:50 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:31:50 user devstack@n-api.service[61615]: Connection: close Apr 12 12:31:50 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:31:50 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:31:50 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:31:50 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:31:50 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPiXNx4HIwx8Zbnzc3F_qzA9lIusaN7B1X2YNN2JszPbikV_WpuZql6iOTofmcBDbC_LdI_V6asfnP-t8zTuIohiV1GoWsm-UrG1dMx4gkqY0vp8KM2U4czRnvr7xgrJyeMrwjJRo-U4HYJL8jBlzYernW68zqIfm1tpFM4NEgm-qY Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Project-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/02f3f538463546f9a0eab47df52e2f56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Tenant-Id: 02f3f538463546f9a0eab47df52e2f56 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2004507714 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-User: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:50 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:31:50 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:31:50 user devstack@n-api.service[61615]: X-User-Id: 66e3fb7903c94cd6a2a709ca0e133ce2 Apr 12 12:31:50 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2004507714-project-member Apr 12 12:31:50 user devstack@n-api.service[61615]: method: > Apr 12 12:31:50 user devstack@n-api.service[61615]: exception: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61615]: action_args: {'id': '2f3ff25a-522c-431b-a177-85177401c7a9'} Apr 12 12:31:50 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. Apr 12 12:31:50 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] Returning 404 to user: Instance 2f3ff25a-522c-431b-a177-85177401c7a9 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-e9f45c80-8768-463f-b421-12aa47a876ba tempest-AttachSCSIVolumeTestJSON-2004507714 tempest-AttachSCSIVolumeTestJSON-2004507714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9" status: 404 len: 111 microversion: 2.1 time: 0.039815 Apr 12 12:31:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:50 2023] GET /compute/v2.1/servers/2f3ff25a-522c-431b-a177-85177401c7a9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-281004fd-b23f-4076-b25d-61624660ca52 tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2" status: 200 len: 503 microversion: 2.49 time: 0.049739 Apr 12 12:31:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 87/248] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 12:31:52 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2 => generated 503 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-054126f1-feda-4bc3-ae88-90457c4d510c tempest-TaggedAttachmentsTest-961468703 tempest-TaggedAttachmentsTest-961468703-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2" status: 200 len: 503 microversion: 2.49 time: 0.094848 Apr 12 12:31:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 79/249] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 12:31:52 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-instance-actions/req-d2140541-89c4-4b95-832b-00673617cfc2 => generated 503 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f30688ad-c3f5-47c2-bfe1-e7528359cbbf tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.043911 Apr 12 12:31:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 84/250] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 12:31:52 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-506df91c-a6c6-4069-af1c-8cf85c32853f tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 204 len: 0 microversion: 2.49 time: 0.113582 Apr 12 12:31:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 88/251] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:31:52 2023] DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] Creating event network-changed:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-36741fd5-798e-47ec-a12f-26991d883f63 req-dd8f32ca-465a-4b99-bb15-1e6d93c3b0a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Apr 12 12:31:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 80/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff191ffb9604795bab6ada1eafd41ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dd2a4a665514d0eb31653775b67356a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-80891c09-76ae-407a-a8af-e2c7c313e14d tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 200 len: 1750 microversion: 2.49 time: 0.314695 Apr 12 12:31:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:31:52 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 1750 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-unplugged", "status": "completed", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] Creating event network-vif-unplugged:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-68416cae-8e09-4291-a120-a6655da0d6a3 req-f0e981a5-97f5-4f1a-a898-054fbbe5c0ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030072 Apr 12 12:31:53 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 89/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:31:53 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf HTTP/1.1 Apr 12 12:31:53 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:31:53 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:31:53 user devstack@n-api.service[61616]: Connection: close Apr 12 12:31:53 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:31:53 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:31:53 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:31:53 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:31:53 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:31:53 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61616]: method: > Apr 12 12:31:53 user devstack@n-api.service[61616]: exception: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61616]: action_args: {'id': '64589bd5-2688-4224-ba3e-8a26f9ffafaf'} Apr 12 12:31:53 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b3499455-e425-4422-890d-6368dc787633 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 404 len: 111 microversion: 2.1 time: 0.045022 Apr 12 12:31:53 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 81/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:53 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:31:53 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf HTTP/1.1 Apr 12 12:31:53 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:31:53 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:31:53 user devstack@n-api.service[61615]: Connection: close Apr 12 12:31:53 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:31:53 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:31:53 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:31:53 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:31:53 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61615]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:31:53 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61615]: method: > Apr 12 12:31:53 user devstack@n-api.service[61615]: exception: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61615]: action_args: {'id': '64589bd5-2688-4224-ba3e-8a26f9ffafaf'} Apr 12 12:31:53 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0f822d18-4ed6-46e2-9629-674634b129e7 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 404 len: 111 microversion: 2.1 time: 0.028173 Apr 12 12:31:53 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:31:53 2023] DELETE /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 64589bd5-2688-4224-ba3e-8a26f9ffafaf] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:31:53 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf HTTP/1.1 Apr 12 12:31:53 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:31:53 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:31:53 user devstack@n-api.service[61614]: Connection: close Apr 12 12:31:53 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:31:53 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:31:53 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:31:53 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:31:53 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:31:53 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:31:53 user devstack@n-api.service[61614]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:31:53 user devstack@n-api.service[61614]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:31:53 user devstack@n-api.service[61614]: method: > Apr 12 12:31:53 user devstack@n-api.service[61614]: exception: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61614]: action_args: {'id': '64589bd5-2688-4224-ba3e-8a26f9ffafaf'} Apr 12 12:31:53 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. Apr 12 12:31:53 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:31:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 64589bd5-2688-4224-ba3e-8a26f9ffafaf could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:31:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-cf705c31-dd23-4462-8479-ab776faaa450 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf" status: 404 len: 111 microversion: 2.1 time: 0.036066 Apr 12 12:31:53 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 90/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:53 2023] GET /compute/v2.1/servers/64589bd5-2688-4224-ba3e-8a26f9ffafaf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:31:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-deleted", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] Creating event network-vif-deleted:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-93cbe325-ec67-4382-8cd9-26fd45aea32b req-0ef4d427-c193-4601-b9da-33936df7bfdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050415 Apr 12 12:31:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 82/258] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:55 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bee3fe-3300-4a28-b079-1bafaa1033c4", "name": "network-vif-plugged", "status": "completed", "tag": "201eadd8-c760-4862-bcce-bcff996371f9"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:55 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] Creating event network-vif-plugged:201eadd8-c760-4862-bcce-bcff996371f9 for instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 on user Apr 12 12:31:55 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-c11a10c1-d5f4-4f9a-8adb-82e963aa6f10 req-0dc621a6-f47e-47c6-82b8-2b51a5a41c14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Apr 12 12:31:55 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:31:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "name": "network-vif-plugged", "status": "completed", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}, {"server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "name": "network-vif-plugged", "status": "completed", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:31:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Creating event network-vif-plugged:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:31:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] Creating event network-vif-plugged:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:31:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-4d3932b2-06fc-49b7-8ae0-166b369f17ec req-fe97aed3-de2e-4eb3-bad6-bb881d7a3e84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054027 Apr 12 12:31:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 91/260] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:31:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:31:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:31:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b65385cf-7d39-4198-a1eb-91ff23693b1c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1504 microversion: 2.1 time: 0.182663 Apr 12 12:31:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 83/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:31:58 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:00 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272654f6bbb4fb39b3c334c32d4688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ad4c8abb3447bd8ad5f5f2e95e2d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b062534b-825a-4db3-bf2e-d05a3834e78e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 200 len: 1566 microversion: 2.1 time: 0.227716 Apr 12 12:32:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:00 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-51459992", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:00 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:32:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54',volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:32:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-32ce3557-d6f4-40df-ba9d-9d6b0a9cc35e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.956641 Apr 12 12:32:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 92/263] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:32:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:32:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7d0513d1-58f2-4eff-b3f3-a0409df18992 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:01 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7d0513d1-58f2-4eff-b3f3-a0409df18992 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:01 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7d0513d1-58f2-4eff-b3f3-a0409df18992 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7d0513d1-58f2-4eff-b3f3-a0409df18992 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 200 len: 1064 microversion: 2.1 time: 0.066571 Apr 12 12:32:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 84/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:01 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 1064 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] Creating event network-changed:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:32:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-4f622401-bdf8-4c8c-b4d1-d54ebc643c8f req-93da530d-f235-4cd5-ab64-de5c2f8bf06a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054334 Apr 12 12:32:05 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "449d635d-4ec1-4536-8979-33cea2764dad"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:05 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-323fc87a-9c4a-4d61-84ce-02a8150d1e93 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362043 Apr 12 12:32:05 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 93/266] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:32:05 2023] POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:32:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] Creating event network-changed:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:32:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-844f8999-ccb7-4353-8614-71e6b2bcb873 req-96abab73-1fd9-4ce7-9f49-e3ffff2f82ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086129 Apr 12 12:32:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 85/267] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HTTP exception thrown: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Request method failure captured: Apr 12 12:32:08 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 HTTP/1.1 Apr 12 12:32:08 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:32:08 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:32:08 user devstack@n-api.service[61615]: Connection: close Apr 12 12:32:08 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:32:08 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:32:08 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:32:08 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:32:08 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPjjaQTZtYZY7F0sa0FChhyl1TK_CdlfMoWUFQrozhEzPhIZliJkKt0CSUbqd1eAxGJEoOc-APP8w83ifnnech5ta1c85nCnlb4VchXXwAKwThGBcdlO-PYWdc9MSOSFMIb2_PcHLwxxnsBOqgSBtdDsQxLyJVj9c6wGEoE-nEWsag Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Project-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Project-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Tenant: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Tenant-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:08 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-User: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:08 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:32:08 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:32:08 user devstack@n-api.service[61615]: X-User-Id: b1cf68007f18458b9824e056151f5c57 Apr 12 12:32:08 user devstack@n-api.service[61615]: X-User-Name: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:08 user devstack@n-api.service[61615]: method: > Apr 12 12:32:08 user devstack@n-api.service[61615]: exception: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:08 user devstack@n-api.service[61615]: action_args: {'id': 'd8867363-6e36-4b34-9cc1-f30fbc572720'} Apr 12 12:32:08 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:08 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Returning 404 to user: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-93e0de65-7f1f-4e38-9d4f-3add3536e2a8 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 404 len: 111 microversion: 2.32 time: 0.031772 Apr 12 12:32:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 90/268] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:32:08 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 12:32:08 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a6a5e8bc-7a1a-4936-8c53-b21e4b6f0343 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '.version_select at 0x7fc95d5aa170>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:08 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a6a5e8bc-7a1a-4936-8c53-b21e4b6f0343 tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404432695" status: 204 len: 0 microversion: 2.32 time: 0.027541 Apr 12 12:32:08 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 94/269] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 12:32:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404432695 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-177ce275-4a87-46bd-b401-055c8e128893 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057247 Apr 12 12:32:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 86/270] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:32:09 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:32:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-cad88d40-b4d6-4fc6-9099-60affb54b4e3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8" status: 204 len: 0 microversion: 2.1 time: 0.137107 Apr 12 12:32:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:32:09 2023] DELETE /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2991a85234e046698761e54b1f203861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c4688a3b0b429fb12d12ab7bd14e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-600d15c1-b511-4125-9a28-93201bbd0e99 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8" status: 200 len: 1649 microversion: 2.1 time: 0.387711 Apr 12 12:32:09 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 95/272] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:09 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 => generated 1649 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "name": "network-vif-unplugged", "status": "completed", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] Creating event network-vif-unplugged:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:32:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-293b3d33-a9c1-464c-beb2-c158fcb0d527 req-6cc82c2e-3d4d-4078-b93a-87af9893688d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053499 Apr 12 12:32:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 87/273] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:11 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "name": "network-vif-plugged", "status": "completed", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] Creating event network-vif-plugged:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:32:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-caef5a42-5dcb-4832-9bdb-478fcf35f34c req-18380b80-9291-4e79-a169-094c924efecf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036689 Apr 12 12:32:11 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "name": "network-vif-plugged", "status": "completed", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}, {"server_uuid": "540a69c0-488f-40cb-bdde-3e410029d4c8", "name": "network-vif-deleted", "tag": "69203d15-c034-4d74-915d-1fc13c89ee40"}, {"server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "name": "network-vif-plugged", "status": "completed", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:13 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Creating event network-vif-plugged:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:32:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Creating event network-vif-deleted:69203d15-c034-4d74-915d-1fc13c89ee40 for instance 540a69c0-488f-40cb-bdde-3e410029d4c8 on user Apr 12 12:32:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] Creating event network-vif-plugged:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:32:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c52418a3-9a96-4cac-8ae3-ca7878ddd3a1 req-9265560a-080c-4aec-8816-37778b90ae03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046723 Apr 12 12:32:13 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 96/275] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d96bfb33-f44e-42da-8168-4284de3312d3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1660 microversion: 2.1 time: 0.427217 Apr 12 12:32:14 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 88/276] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:14 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1660 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2a363ad-a0a5-4076-9530-5488fad60936"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HTTP exception thrown: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Request method failure captured: Apr 12 12:32:14 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 HTTP/1.1 Apr 12 12:32:14 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:32:14 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:32:14 user devstack@n-api.service[61616]: Connection: close Apr 12 12:32:14 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:32:14 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:32:14 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:32:14 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:32:14 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPjjaQTZtYZY7F0sa0FChhyl1TK_CdlfMoWUFQrozhEzPhIZliJkKt0CSUbqd1eAxGJEoOc-APP8w83ifnnech5ta1c85nCnlb4VchXXwAKwThGBcdlO-PYWdc9MSOSFMIb2_PcHLwxxnsBOqgSBtdDsQxLyJVj9c6wGEoE-nEWsag Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Id: b1cf68007f18458b9824e056151f5c57 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Name: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:14 user devstack@n-api.service[61616]: method: > Apr 12 12:32:14 user devstack@n-api.service[61616]: exception: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: action_args: {'id': 'd8867363-6e36-4b34-9cc1-f30fbc572720'} Apr 12 12:32:14 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Returning 404 to user: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-91899cbe-c24d-41b4-b287-e8857e30408d tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 404 len: 111 microversion: 2.32 time: 0.046955 Apr 12 12:32:14 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 89/277] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:32:14 2023] DELETE /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] [instance: d8867363-6e36-4b34-9cc1-f30fbc572720] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] HTTP exception thrown: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Request method failure captured: Apr 12 12:32:14 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 HTTP/1.1 Apr 12 12:32:14 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:32:14 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:32:14 user devstack@n-api.service[61616]: Connection: close Apr 12 12:32:14 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:32:14 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:32:14 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:32:14 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:32:14 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPjjaQTZtYZY7F0sa0FChhyl1TK_CdlfMoWUFQrozhEzPhIZliJkKt0CSUbqd1eAxGJEoOc-APP8w83ifnnech5ta1c85nCnlb4VchXXwAKwThGBcdlO-PYWdc9MSOSFMIb2_PcHLwxxnsBOqgSBtdDsQxLyJVj9c6wGEoE-nEWsag Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Project-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed98064a134b4603bbf641f45988564a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed98064a134b4603bbf641f45988564a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant-Id: ed98064a134b4603bbf641f45988564a Apr 12 12:32:14 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TaggedBootDevicesTest-350828706 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Id: b1cf68007f18458b9824e056151f5c57 Apr 12 12:32:14 user devstack@n-api.service[61616]: X-User-Name: tempest-TaggedBootDevicesTest-350828706-project-member Apr 12 12:32:14 user devstack@n-api.service[61616]: method: > Apr 12 12:32:14 user devstack@n-api.service[61616]: exception: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: action_args: {'id': 'd8867363-6e36-4b34-9cc1-f30fbc572720'} Apr 12 12:32:14 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. Apr 12 12:32:14 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] Returning 404 to user: Instance d8867363-6e36-4b34-9cc1-f30fbc572720 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-3fa82b35-3015-4f24-aa4d-78d6234400ec tempest-TaggedBootDevicesTest-350828706 tempest-TaggedBootDevicesTest-350828706-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720" status: 404 len: 111 microversion: 2.32 time: 0.040013 Apr 12 12:32:14 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 90/278] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:32:14 2023] GET /compute/v2.1/servers/d8867363-6e36-4b34-9cc1-f30fbc572720 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 12:32:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-bee18104-d914-4a0f-9823-66bd8861b623 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481649 Apr 12 12:32:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 93/279] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:32:14 2023] POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-72e19c7d-61a8-4028-9b4c-e65b501cec34 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Action: 'create', calling method: .version_select at 0x7fc95d417130>, body: {"keypair": {"name": "tempest-keypair-323125528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwfNw+fvD7X4C2arQ/IOvs3K4y/lgQ5Pq3fO+j5VSF5Rg09hb2/k2StMjL05qEGcPBIk8YLKdGWWdEzgPlfvaKjg/N0ZO7tOTPs9daq6f05+grV+GuA4jxUJKEMKKnlXA=="}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:15 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-72e19c7d-61a8-4028-9b4c-e65b501cec34 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for project 7d607e0aed1f47129540181261c6ebc7. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:15 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-72e19c7d-61a8-4028-9b4c-e65b501cec34 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for user b3a887c10bf74974a648e3ec048fcdd7 and project 7d607e0aed1f47129540181261c6ebc7. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-72e19c7d-61a8-4028-9b4c-e65b501cec34 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.478280 Apr 12 12:32:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 97/280] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:32:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:16 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1d87d031-577e-4c32-b178-522f1d919efc tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1671 microversion: 2.1 time: 0.593068 Apr 12 12:32:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 91/281] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:16 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1671 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1385172831", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "6e43ca53-1563-43b0-84cc-d3f759c61c37"}], "security_groups": [{"name": "tempest-securitygroup--223823673"}], "key_name": "tempest-keypair-323125528", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] validate_networks() for [('6e43ca53-1563-43b0-84cc-d3f759c61c37', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:18 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for project 7d607e0aed1f47129540181261c6ebc7. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:18 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for user b3a887c10bf74974a648e3ec048fcdd7 and project 7d607e0aed1f47129540181261c6ebc7. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:32:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:32:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d3f11f6e-0ad0-4349-bb51-186422e5fb1c tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.737124 Apr 12 12:32:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 94/282] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:32:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:32:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a46490e1-66cc-4a59-875c-1bcc9831c863 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:18 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a46490e1-66cc-4a59-875c-1bcc9831c863 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:18 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-a46490e1-66cc-4a59-875c-1bcc9831c863 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a46490e1-66cc-4a59-875c-1bcc9831c863 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29" status: 200 len: 1235 microversion: 2.1 time: 0.111521 Apr 12 12:32:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 98/283] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:18 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => generated 1235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2586924-e0c3-4908-8f2c-7375bf258d7f"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2cae0806-e0a4-49f6-b82e-b6368e5ba387 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543752 Apr 12 12:32:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 92/284] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:32:19 2023] POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] Creating event network-changed:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:32:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f67f2482-1fc8-4c08-abe9-b4d92ff26b10 req-dc6fe6ea-9564-48ff-9ded-1ec2adfffe75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035400 Apr 12 12:32:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 95/285] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:22 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'services' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:32:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2274d4bb-05fa-49c2-bfc9-d6ed08838f1e tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/449d635d-4ec1-4536-8979-33cea2764dad" status: 202 len: 0 microversion: 2.1 time: 0.304426 Apr 12 12:32:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 99/286] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:32:22 2023] DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/449d635d-4ec1-4536-8979-33cea2764dad => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b47ee2ba-85c5-4c82-a3a0-12bdc08c49db tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Apr 12 12:32:22 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 93/287] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:32:22 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:23 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:23 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5c898f25-7416-4207-b520-ae3077cc6985 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1706 microversion: 2.1 time: 0.625023 Apr 12 12:32:23 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 96/288] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:22 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1706 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-548854806", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: dict_keys(['metadata_items']) {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: dict_keys(['metadata_items']) {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6a3e60f7-99b3-4536-b250-997ae456fe83 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action" status: 202 len: 1160 microversion: 2.1 time: 0.508015 Apr 12 12:32:24 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 100/289] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 12:32:23 2023] POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action => generated 1160 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:24 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:24 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c9cd1d37-c989-494f-9068-5eb6124170e2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1733 microversion: 2.1 time: 0.280073 Apr 12 12:32:24 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 94/290] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:24 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "name": "network-vif-plugged", "status": "completed", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] Creating event network-vif-plugged:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:32:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-84c9c06d-b548-452b-95d4-120029272ce1 req-915bf633-e5c3-4feb-9601-79b2ac257b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036806 Apr 12 12:32:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 97/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:32:26 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "name": "network-vif-plugged", "status": "completed", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}, {"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-unplugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}, {"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Creating event network-vif-plugged:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:32:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Creating event network-vif-unplugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:32:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:32:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-af4dcfbe-48f2-4c30-aee4-bb3bed327153 req-537dff4d-331f-4dd4-9afb-0ef153ac2cfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.063458 Apr 12 12:32:26 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 101/292] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1a7cdce6-23be-41d4-a5cc-e9053f94d2ce"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:28 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'flavor' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:32:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-73690315-2b3d-4d05-b604-660c69d3c4c9 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action" status: 200 len: 29 microversion: 2.1 time: 0.230296 Apr 12 12:32:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 95/293] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:32:28 2023] POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action => generated 29 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:29 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b71c2e64-6abd-41db-8b8d-9d8655cb4b13 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1723 microversion: 2.1 time: 0.221524 Apr 12 12:32:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 98/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:29 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] Creating event network-vif-unplugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:32:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f2b516b2-5420-4762-9776-43c192d3cae3 req-6334198f-6104-428d-8df2-68a57f51926e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039403 Apr 12 12:32:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 102/295] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:32 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:32:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-64b370dc-205c-4e78-ac85-3056f9a14909 req-3b8cbaf1-5c60-4bdf-bd05-00c6e755a382 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038706 Apr 12 12:32:32 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 96/296] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 651d5c05-2d02-450f-a33c-fbd9b3109016] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] HTTP exception thrown: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Request method failure captured: Apr 12 12:32:34 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 HTTP/1.1 Apr 12 12:32:34 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:32:34 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:32:34 user devstack@n-api.service[61615]: Connection: close Apr 12 12:32:34 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:32:34 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:32:34 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:32:34 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:32:34 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQkRJEry3bzlhA6Lakva2SnUhnNOpBjm2uXMAoA3lQKvfrGxQVZFv4biWQXqoT3Gy0d_IURt-ScSSOu5E-qpR3SHizSoOrY1M1P90lXO7gKWhzhhPwzbjZJmkVf_WtcIxCrx3HQ_1qFwAzh2HuqdM_bNZxANxSFmBa2nJ4d5dWPUoc Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Project-Id: 466d2a494cf64002a98588909bdcd197 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/466d2a494cf64002a98588909bdcd197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/466d2a494cf64002a98588909bdcd197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/466d2a494cf64002a98588909bdcd197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Tenant-Id: 466d2a494cf64002a98588909bdcd197 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-User: tempest-VolumesSnapshotTestJSON-760244133-project-member Apr 12 12:32:34 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:32:34 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:32:34 user devstack@n-api.service[61615]: X-User-Id: 35727e3b48da4494808015e2b630a3f9 Apr 12 12:32:34 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesSnapshotTestJSON-760244133-project-member Apr 12 12:32:34 user devstack@n-api.service[61615]: method: > Apr 12 12:32:34 user devstack@n-api.service[61615]: exception: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. Apr 12 12:32:34 user devstack@n-api.service[61615]: action_args: {'id': '651d5c05-2d02-450f-a33c-fbd9b3109016'} Apr 12 12:32:34 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. Apr 12 12:32:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Returning 404 to user: Instance 651d5c05-2d02-450f-a33c-fbd9b3109016 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-67fcb5fe-2883-4582-9247-4a85bb417bd6 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016" status: 404 len: 111 microversion: 2.1 time: 0.032304 Apr 12 12:32:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:34 2023] GET /compute/v2.1/servers/651d5c05-2d02-450f-a33c-fbd9b3109016 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:32:34 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:32:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-2833adff-d4ac-4de6-bc7f-2f0317c0ca35 req-13bb7321-bde4-4d24-a5eb-cfc18ebdeac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043523 Apr 12 12:32:34 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 103/298] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:32:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-afe6979f-4daf-407e-a7f7-750c537a91f9 req-839301ba-959d-4d77-8ba5-4fad49531884 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038614 Apr 12 12:32:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 97/299] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:32:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-662753d2-8886-42e1-b169-5d836f0d6cdc req-cf95148b-04ac-42a2-93c2-9d30a9ffefbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050450 Apr 12 12:32:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 100/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:32:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-5709a062-96ba-4319-bdcc-7068fb34b556 req-1e8d34de-7d55-4a3d-bc46-42dbf9326dbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165310 Apr 12 12:32:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 98/301] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeb0b1b08ba4cbcb08705c49517f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc629696bdf4ed2bc9da7e20e8102fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c8a684ef-6917-4a75-b67c-0aa878c59dfc tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4" status: 200 len: 1452 microversion: 2.1 time: 0.676620 Apr 12 12:32:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 104/302] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:39 2023] GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 => generated 1452 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-af31a1cb-ad18-4011-8e21-9323112049de tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: .version_select at 0x7fc95d42f010>, body: {"keypair": {"name": "tempest-keypair-250399543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZrjP9KAJCgyaL5zcIDkfonF0SjjghGFN4rxSk+Gs/fi7zbEzghBorK6ScclR6/kTKn5pVT08v7lhEUGdgEMCcBQsph3fKqP0aQS3e3cPR0dYvUMVDLU1ho++DwuWEcA=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:41 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-af31a1cb-ad18-4011-8e21-9323112049de tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:41 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-af31a1cb-ad18-4011-8e21-9323112049de tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for user 46e4935eed324b868477f8e88918364a and project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-af31a1cb-ad18-4011-8e21-9323112049de tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.234900 Apr 12 12:32:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 101/303] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 12:32:40 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:32:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-806455308", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4ba97279-e122-4c2b-b931-dde33e1d71df"}], "security_groups": [{"name": "tempest-securitygroup--1878529601"}], "key_name": "tempest-keypair-250399543", "user_data": "}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] validate_networks() for [('4ba97279-e122-4c2b-b931-dde33e1d71df', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] HTTP exception thrown: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Request method failure captured: Apr 12 12:32:43 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 HTTP/1.1 Apr 12 12:32:43 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:32:43 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:32:43 user devstack@n-api.service[61614]: Connection: close Apr 12 12:32:43 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:32:43 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:32:43 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:32:43 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:32:43 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPhzHGw7Ql4kI9EeLq3Y17YsA0jEnk9i_A7PEdoHdNQ6oP37zh3Xxer31LO6Q7vusai7Bqw0WYiN5xXTsPUujaDfrA97QJBYkoQh1vnuiXtyQLvFkALj7OhJgTZUB-28axClxJLPobuXUwwt1iIPKRqHKfCDWxmmGT9-uD2X8847kI Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Project-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Project-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Tenant: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Tenant-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:43 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:43 user devstack@n-api.service[61614]: X-User: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:43 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:32:43 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:32:43 user devstack@n-api.service[61614]: X-User-Id: 2ff191ffb9604795bab6ada1eafd41ff Apr 12 12:32:43 user devstack@n-api.service[61614]: X-User-Name: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:43 user devstack@n-api.service[61614]: method: > Apr 12 12:32:43 user devstack@n-api.service[61614]: exception: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:43 user devstack@n-api.service[61614]: action_args: {'id': '79bee3fe-3300-4a28-b079-1bafaa1033c4'} Apr 12 12:32:43 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:43 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Returning 404 to user: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2b41c636-a5e1-4904-ad06-87490e09dd1e tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 404 len: 111 microversion: 2.49 time: 0.053883 Apr 12 12:32:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 105/304] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:32:43 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:32:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c1932655-6b98-4f50-8916-63de6b00fdac tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '.version_select at 0x7fc95d682cb0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c1932655-6b98-4f50-8916-63de6b00fdac tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134546144" status: 204 len: 0 microversion: 2.49 time: 0.028402 Apr 12 12:32:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 102/305] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 12:32:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134546144 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for user 46e4935eed324b868477f8e88918364a and project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:32:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:32:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-838fa6dd-b471-4bb6-b65b-7c68e54a9899 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.656946 Apr 12 12:32:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 99/306] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 12:32:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4dd5e9d0-4470-4127-a899-e37e7c506c57 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1274 microversion: 2.20 time: 0.129624 Apr 12 12:32:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 106/307] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:32:43 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:32:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1237193295", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "0fcb9046-707e-462c-937c-3ba5aebe64e8"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:44 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] validate_networks() for [('0fcb9046-707e-462c-937c-3ba5aebe64e8', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting quotas for project 466d2a494cf64002a98588909bdcd197. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Getting quotas for user 35727e3b48da4494808015e2b630a3f9 and project 466d2a494cf64002a98588909bdcd197. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fec35adf-4871-498b-bff6-c5b89416fa5a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.865453 Apr 12 12:32:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 103/308] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:32:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] HTTP exception thrown: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-33564413-1cb5-4935-847f-0e3a4a1f64dc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-33564413-1cb5-4935-847f-0e3a4a1f64dc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Request method failure captured: Apr 12 12:32:45 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 HTTP/1.1 Apr 12 12:32:45 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:32:45 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:32:45 user devstack@n-api.service[61616]: Connection: close Apr 12 12:32:45 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:32:45 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:32:45 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:32:45 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:32:45 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPhzHGw7Ql4kI9EeLq3Y17YsA0jEnk9i_A7PEdoHdNQ6oP37zh3Xxer31LO6Q7vusai7Bqw0WYiN5xXTsPUujaDfrA97QJBYkoQh1vnuiXtyQLvFkALj7OhJgTZUB-28axClxJLPobuXUwwt1iIPKRqHKfCDWxmmGT9-uD2X8847kI Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Project-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Project-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Tenant: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Tenant-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:45 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61616]: X-User: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:45 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:32:45 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:32:45 user devstack@n-api.service[61616]: X-User-Id: 2ff191ffb9604795bab6ada1eafd41ff Apr 12 12:32:45 user devstack@n-api.service[61616]: X-User-Name: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:45 user devstack@n-api.service[61616]: method: > Apr 12 12:32:45 user devstack@n-api.service[61616]: exception: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61616]: action_args: {'id': '79bee3fe-3300-4a28-b079-1bafaa1033c4'} Apr 12 12:32:45 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Returning 404 to user: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-22460159-0fd3-4307-a1e5-94f75998edf1 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 404 len: 111 microversion: 2.49 time: 0.038164 Apr 12 12:32:45 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 100/309] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:32:45 2023] DELETE /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:32:45 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] [instance: 79bee3fe-3300-4a28-b079-1bafaa1033c4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] HTTP exception thrown: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Request method failure captured: Apr 12 12:32:45 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 HTTP/1.1 Apr 12 12:32:45 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:32:45 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:32:45 user devstack@n-api.service[61615]: Connection: close Apr 12 12:32:45 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:32:45 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:32:45 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:32:45 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:32:45 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPhzHGw7Ql4kI9EeLq3Y17YsA0jEnk9i_A7PEdoHdNQ6oP37zh3Xxer31LO6Q7vusai7Bqw0WYiN5xXTsPUujaDfrA97QJBYkoQh1vnuiXtyQLvFkALj7OhJgTZUB-28axClxJLPobuXUwwt1iIPKRqHKfCDWxmmGT9-uD2X8847kI Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Project-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Project-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dd2a4a665514d0eb31653775b67356a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Tenant: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Tenant-Id: 0dd2a4a665514d0eb31653775b67356a Apr 12 12:32:45 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1949865572 Apr 12 12:32:45 user devstack@n-api.service[61615]: X-User: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:45 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:32:45 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:32:45 user devstack@n-api.service[61615]: X-User-Id: 2ff191ffb9604795bab6ada1eafd41ff Apr 12 12:32:45 user devstack@n-api.service[61615]: X-User-Name: tempest-TaggedAttachmentsTest-1949865572-project-member Apr 12 12:32:45 user devstack@n-api.service[61615]: method: > Apr 12 12:32:45 user devstack@n-api.service[61615]: exception: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61615]: action_args: {'id': '79bee3fe-3300-4a28-b079-1bafaa1033c4'} Apr 12 12:32:45 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. Apr 12 12:32:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] Returning 404 to user: Instance 79bee3fe-3300-4a28-b079-1bafaa1033c4 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4f20d7b8-bf88-48fe-853e-ee255f3ca776 tempest-TaggedAttachmentsTest-1949865572 tempest-TaggedAttachmentsTest-1949865572-project-member] 10.0.0.210 "GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4" status: 404 len: 111 microversion: 2.49 time: 0.033759 Apr 12 12:32:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 104/310] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:32:45 2023] GET /compute/v2.1/servers/79bee3fe-3300-4a28-b079-1bafaa1033c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:32:45 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-33564413-1cb5-4935-847f-0e3a4a1f64dc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-33564413-1cb5-4935-847f-0e3a4a1f64dc tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1" status: 200 len: 1213 microversion: 2.1 time: 0.091354 Apr 12 12:32:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 107/311] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:45 2023] GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] Creating event network-changed:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:32:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e7b2cd5b-e264-4418-9fb7-2b44a3433c83 req-52a4d634-0bd6-4ebf-8635-798e7400a922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038579 Apr 12 12:32:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 101/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:48 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:48 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] Creating event network-changed:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:32:48 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d50f3103-6bb7-4f7c-87b3-b83c65d9105a req-cc54ae35-8fe6-4e70-a52b-1adad56d3abc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085697 Apr 12 12:32:48 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}, {"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:50 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=4,nova_cell1:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:32:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:32:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-d6c9e3bf-7d9e-43b2-b1c4-c073fa084e50 req-15014306-6022-41cd-a4ac-4509f7ea8ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051425 Apr 12 12:32:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 108/314] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "name": "network-vif-plugged", "status": "completed", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] Creating event network-vif-plugged:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:32:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-4722d876-d9cc-4cfa-abd1-22082dd47320 req-7047e40e-09a2-4e23-a8c9-52832b224c81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044878 Apr 12 12:32:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 102/315] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:32:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-aff7bf06-3e88-4d8d-a451-06165880a940 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 200 len: 1390 microversion: 2.1 time: 0.231106 Apr 12 12:32:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:51 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:32:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "name": "network-vif-plugged", "status": "completed", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] Creating event network-vif-plugged:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:32:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-676d7e3a-7981-4014-bb94-10d78f2423de req-432c0cc6-c2b8-472a-98c2-5e4911452539 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034282 Apr 12 12:32:53 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 109/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:32:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:59 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 10116da0-785c-41cf-96bb-95721af863db {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] [instance: 540a69c0-488f-40cb-bdde-3e410029d4c8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=10 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] HTTP exception thrown: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Request method failure captured: Apr 12 12:32:59 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 HTTP/1.1 Apr 12 12:32:59 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:32:59 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:32:59 user devstack@n-api.service[61615]: Connection: close Apr 12 12:32:59 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:32:59 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:32:59 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:32:59 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:32:59 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPli6FJxkbwI8qMp04RFKOsWu8zQyClV-NMPYTxpV44NW1Ge4GB0YtrGK692U1TQBBSG-SRhTfQvAoUeZGmA6r4XSQg0kEkpLm99zU2WaPa6y4H6Jh6pAjcEXuzVuQ7Sr03aJf7pJ-CvJT_H8TAJXOGKVJCFkl6Q8DsaZGTXbbwqCQ Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Project-Id: d5c4688a3b0b429fb12d12ab7bd14e43 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeSwap-1492117268 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5c4688a3b0b429fb12d12ab7bd14e43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5c4688a3b0b429fb12d12ab7bd14e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5c4688a3b0b429fb12d12ab7bd14e43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeSwap-1492117268 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Tenant-Id: d5c4688a3b0b429fb12d12ab7bd14e43 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeSwap-1492117268 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeSwap-1492117268-project-member Apr 12 12:32:59 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:32:59 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:32:59 user devstack@n-api.service[61615]: X-User-Id: 2991a85234e046698761e54b1f203861 Apr 12 12:32:59 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeSwap-1492117268-project-member Apr 12 12:32:59 user devstack@n-api.service[61615]: method: > Apr 12 12:32:59 user devstack@n-api.service[61615]: exception: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. Apr 12 12:32:59 user devstack@n-api.service[61615]: action_args: {'id': '540a69c0-488f-40cb-bdde-3e410029d4c8'} Apr 12 12:32:59 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. Apr 12 12:32:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Returning 404 to user: Instance 540a69c0-488f-40cb-bdde-3e410029d4c8 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:32:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d1708106-ed16-4f74-a556-b8e68bda1279 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8" status: 404 len: 111 microversion: 2.1 time: 0.030700 Apr 12 12:32:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:59 2023] GET /compute/v2.1/servers/540a69c0-488f-40cb-bdde-3e410029d4c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:32:59 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:32:59 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-85bbed9b-86b7-4f73-af82-9b12da2ffea3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] Calling method '.version_select at 0x7fc95d379cf0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:59 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ec78e1fb-2c25-4c74-882a-b6a89670c48e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/action" status: 200 len: 32 microversion: 2.1 time: 0.141603 Apr 12 12:32:59 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 103/319] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:32:59 2023] POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:32:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-85bbed9b-86b7-4f73-af82-9b12da2ffea3 tempest-TestVolumeSwap-1492117268 tempest-TestVolumeSwap-1492117268-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155106394" status: 202 len: 0 microversion: 2.1 time: 0.050714 Apr 12 12:32:59 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 110/320] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:32:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155106394 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:32:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:00 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-942be489-33e8-4c01-9a4d-ee8998b954af tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1510 microversion: 2.1 time: 0.564810 Apr 12 12:33:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:32:59 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1510 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-unplugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] Creating event network-vif-unplugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:33:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-15320253-0cfa-40fe-85c5-2d36e53eec03 req-066a3938-f0c7-4a55-baa6-c261a29523ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067649 Apr 12 12:33:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 104/322] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:33:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-3a642664-2d77-46be-8055-d34fe164c475 req-28b02d2a-37f5-4b90-b743-e49ea29997a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068731 Apr 12 12:33:03 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 111/323] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-17230305", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] validate_networks() for [('963759e8-808d-494c-9dea-0efa9f78804a', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:33:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}, {"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:33:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:33:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-c5250ba4-aa96-45cf-ad1c-2cd35139e1d0 req-a01b1ff0-a18d-47bc-bf0c-190739e2b0be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046980 Apr 12 12:33:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 105/324] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting quotas for project 7ab04e4f968f4c07af43f3fe6651713a. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting quotas for user bc42504b7aab4fedb136acd998adeddb and project 7ab04e4f968f4c07af43f3fe6651713a. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:33:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:33:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-210e14ba-658e-4f68-b268-ef227ba81266 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.712930 Apr 12 12:33:05 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:33:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:33:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-25c0d697-c7b4-4d4e-9ddd-1d86d8b0f86c tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:06 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-25c0d697-c7b4-4d4e-9ddd-1d86d8b0f86c tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:06 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-25c0d697-c7b4-4d4e-9ddd-1d86d8b0f86c tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-25c0d697-c7b4-4d4e-9ddd-1d86d8b0f86c tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1209 microversion: 2.1 time: 0.206589 Apr 12 12:33:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 112/326] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:05 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1209 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-08bb2861-270a-445c-85d7-583a5b932d72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29" status: 200 len: 1543 microversion: 2.1 time: 0.341799 Apr 12 12:33:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 106/327] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:08 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => generated 1543 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] Creating event network-changed:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:33:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-47045a0e-cdd7-4918-b2f8-9683a840c016 req-814ab14c-46c2-461b-9da3-07735fc23cc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Apr 12 12:33:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "name": "network-vif-plugged", "status": "completed", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] Creating event network-vif-plugged:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:33:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-e5ec4933-ece0-42ec-a5f2-f9fbb61ed6f2 req-28af3d74-e1ae-4791-8802-a9fc8a3b0026 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040862 Apr 12 12:33:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 113/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:12 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d3efe43a-0fc8-4fe5-8673-f49fbb9ed586 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065587 Apr 12 12:33:12 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 107/330] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:33:12 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:33:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "name": "network-vif-plugged", "status": "completed", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] Creating event network-vif-plugged:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:33:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-527a0b3b-705b-47dd-a5ec-eb2fa3bc6a91 req-3f1fa96d-8c39-44fc-b322-b7c3b5679684 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048414 Apr 12 12:33:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:14 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:14 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ef87b07b-e304-45d6-8e9c-115e1908b4b7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.225005 Apr 12 12:33:14 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 114/332] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:14 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cf147c-77ee-4b66-83bd-b6421617f8e7"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=16 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-34b1c888-13cf-4bdc-8cc9-273a37ad32a7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411143 Apr 12 12:33:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 108/333] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:33:15 2023] POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=26 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:19 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-961a6805-b26b-4f2f-abe5-7a186112ea40 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1703 microversion: 2.1 time: 0.185423 Apr 12 12:33:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:19 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1703 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=13 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:25 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'services' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:33:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c979cb09-d681-4afb-b23a-c4d78ef848d3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/46cf147c-77ee-4b66-83bd-b6421617f8e7" status: 202 len: 0 microversion: 2.1 time: 0.201869 Apr 12 12:33:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 115/335] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:33:25 2023] DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/46cf147c-77ee-4b66-83bd-b6421617f8e7 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:25 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:25 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-65bf54a0-8d56-488f-a4da-797dafb47cf3 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085240 Apr 12 12:33:25 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 109/336] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:33:25 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=5 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-531e4cab-ab3b-412f-b7fd-6d2f0caaa504 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1585 microversion: 2.20 time: 0.171663 Apr 12 12:33:33 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 113/337] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:33:33 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1585 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:35 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8ed3cb1a-470d-478a-beaf-2f64483aa70b tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1" status: 200 len: 1495 microversion: 2.1 time: 0.187245 Apr 12 12:33:35 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 116/338] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:35 2023] GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 => generated 1495 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:38 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-29b77319-6b74-40c0-aa66-adc888c589e0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Action: 'create', calling method: .version_select at 0x7fc95d397400>, body: {"keypair": {"name": "tempest-keypair-2067665587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxNMexTFhDz2xFUAc4wGA58bVNqR+Fa59qGoEiKr99V0q4IOgnoQTzSr7XTI3nk5SwdCrf8QdfX2WZWlW4pIaFx6quZwUHVtAENs6MteuKUONpmPxi7z1AGiMPLRGF49A=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:38 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:38 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=5 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-29b77319-6b74-40c0-aa66-adc888c589e0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting quotas for project f89f1f2dba8e4325b550ad91403e60ad. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:33:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-29b77319-6b74-40c0-aa66-adc888c589e0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting quotas for user 5e17bc9d4cf743c19f9493d30b62fc16 and project f89f1f2dba8e4325b550ad91403e60ad. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:33:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-29b77319-6b74-40c0-aa66-adc888c589e0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.055942 Apr 12 12:33:38 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 110/339] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 12:33:38 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:33:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3bc44de8-c835-4334-b021-0bf30c5187b0 tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4" status: 204 len: 0 microversion: 2.1 time: 0.109138 Apr 12 12:33:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 114/340] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:33:40 2023] DELETE /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddeb0b1b08ba4cbcb08705c49517f43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc629696bdf4ed2bc9da7e20e8102fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-256759259", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "255979eb-ff62-4b24-9a5a-06bc3b6da2c2"}, {"port": "76450ca6-4f7a-4e03-9269-feaacfced76a", "tag": "port-1"}, {"port": "5dfbb175-cb83-461e-91da-d7cbde98c3e6", "tag": "port-2"}, {"uuid": "cdff297b-c932-49f5-8f91-31b7a475af78", "tag": "net-1"}, {"uuid": "cdff297b-c932-49f5-8f91-31b7a475af78"}, {"uuid": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d2127306-286f-42cb-9dcf-1b4c2e4a9861", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a2ae34a9-43d0-4111-84c5-370193d88db8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "82dcc4b0-743f-4c37-97fc-757dae433d0f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--698738868"}], "key_name": "tempest-keypair-2067665587", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b1b2d37f-4650-45a4-b906-3456882da6fb tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4" status: 200 len: 1458 microversion: 2.1 time: 0.173857 Apr 12 12:33:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 117/341] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:40 2023] GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 => generated 1458 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:40 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] validate_networks() for [('255979eb-ff62-4b24-9a5a-06bc3b6da2c2', None, None, None, None, None), (None, None, '76450ca6-4f7a-4e03-9269-feaacfced76a', None, None, None), (None, None, '5dfbb175-cb83-461e-91da-d7cbde98c3e6', None, None, None), ('cdff297b-c932-49f5-8f91-31b7a475af78', None, None, None, None, None), ('cdff297b-c932-49f5-8f91-31b7a475af78', None, None, None, None, None), ('d2127306-286f-42cb-9dcf-1b4c2e4a9861', '10.2.2.100', None, None, None, None), ('d2127306-286f-42cb-9dcf-1b4c2e4a9861', '10.2.2.200', None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "name": "network-vif-unplugged", "status": "completed", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] Creating event network-vif-unplugged:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:33:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-8e49f557-192a-4ef3-b272-d427fd4873f2 req-b44f0e17-bc20-490a-ad7a-8a688d8dc56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154335 Apr 12 12:33:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:41 user devstack@n-api.service[61616]: Exception ignored in: . at 0x7fc95d397400> Apr 12 12:33:41 user devstack@n-api.service[61616]: Traceback (most recent call last): Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 498, in Apr 12 12:33:41 user devstack@n-api.service[61616]: and _finalize_fairy(None, rec, pool, ref, echo, True), Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 790, in _finalize_fairy Apr 12 12:33:41 user devstack@n-api.service[61616]: connection_record.checkin() Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 531, in checkin Apr 12 12:33:41 user devstack@n-api.service[61616]: pool.dispatch.checkin(connection, self) Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/event/attr.py", line 334, in __call__ Apr 12 12:33:41 user devstack@n-api.service[61616]: fn(*args, **kw) Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Apr 12 12:33:41 user devstack@n-api.service[61616]: time.sleep(0) Apr 12 12:33:41 user devstack@n-api.service[61616]: File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 33, in sleep Apr 12 12:33:41 user devstack@n-api.service[61616]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Apr 12 12:33:41 user devstack@n-api.service[61616]: AssertionError: do not call blocking functions from the mainloop Apr 12 12:33:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "name": "network-vif-plugged", "status": "completed", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}, {"server_uuid": "49339083-8dd4-454b-b7aa-73d91238bef4", "name": "network-vif-deleted", "tag": "c1091e67-edef-41a6-bb9e-e1928024f799"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Creating event network-vif-plugged:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:33:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] Creating event network-vif-deleted:c1091e67-edef-41a6-bb9e-e1928024f799 for instance 49339083-8dd4-454b-b7aa-73d91238bef4 on user Apr 12 12:33:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-7683c5a8-14ea-45a7-b82b-c4ded06431d4 req-1c85ec1d-412e-4744-a23e-1d757cca4276 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039182 Apr 12 12:33:42 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 118/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting quotas for project f89f1f2dba8e4325b550ad91403e60ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Getting quotas for user 5e17bc9d4cf743c19f9493d30b62fc16 and project f89f1f2dba8e4325b550ad91403e60ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:33:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0402afa5-d84d-45d0-9dbf-3e1a9fe31a7d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a2ae34a9-43d0-4111-84c5-370193d88db8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82dcc4b0-743f-4c37-97fc-757dae433d0f',volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:33:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-0d89e0f8-8c19-4572-a37e-b8c257bcbf91 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.192333 Apr 12 12:33:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 111/344] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 12:33:40 2023] POST /compute/v2.1/servers => generated 403 bytes in 3194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:33:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-179d6640-2799-40f4-aac8-cdd13ff19585 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 200 len: 1279 microversion: 2.42 time: 0.066522 Apr 12 12:33:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 116/345] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:33:43 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 1279 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:33:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] Creating event network-changed:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a1c5dbf9-b631-4311-93d3-60c1a9303aac req-64321216-232e-4f87-9dad-a80ed6b474a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031997 Apr 12 12:33:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 119/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:50 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-05ade8ab-b3fe-4610-acb7-6ff82d780a4d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1490 microversion: 2.1 time: 0.330057 Apr 12 12:33:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 112/347] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:50 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1490 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "76450ca6-4f7a-4e03-9269-feaacfced76a"}, {"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "5dfbb175-cb83-461e-91da-d7cbde98c3e6"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Creating event network-changed:76450ca6-4f7a-4e03-9269-feaacfced76a for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] Creating event network-changed:5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-23e54edb-47d7-4f24-a667-edddc5a008c3 req-1e30459d-0173-411a-b668-9fd8520e4a1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038077 Apr 12 12:33:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:52 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-edca1b6e-79d2-4cbf-b4b4-eb1ee5eac5d6 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 200 len: 1390 microversion: 2.1 time: 0.148655 Apr 12 12:33:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 120/349] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:52 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 1390 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-286937470"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:52 user devstack@n-api.service[61616]: INFO nova.compute.api [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Attempting to quiesce instance before volume snapshot. Apr 12 12:33:52 user devstack@n-api.service[61616]: INFO nova.compute.api [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 12:33:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Creating snapshot from volume f704b1c8-3cbd-4b8f-b63a-dfaaf8868a54. {{(pid=61616) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 12:33:53 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:53 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}, {"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Creating event network-changed:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] Creating event network-changed:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-ef4564b3-c5c6-4801-a2f2-426016c00993 req-453dd856-1f79-46d7-bebf-2ae4f51dfd52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032733 Apr 12 12:33:53 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 118/350] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:33:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d26e191c-337e-425e-8930-b6460703b044 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94/action" status: 202 len: 0 microversion: 2.1 time: 2.985924 Apr 12 12:33:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 113/351] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:33:52 2023] POST /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94/action => generated 0 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 12:33:55 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}, {"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Creating event network-changed:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] Creating event network-changed:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:33:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-846d4bb6-d6c8-44cc-99bd-da7e2bf4112e req-62aa9ff2-0dbc-49cb-b83e-e4aacfb35491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.028348 Apr 12 12:33:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 121/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:33:55 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:33:55 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-17042605", "imageRef": "5bf323e0-2e87-46b7-99e8-e588b4d03a87", "flavorRef": "42", "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:55 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:33:56 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='fca54acc-fe2c-4a63-b476-9ecf7045a772',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:33:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b4bc2ed2-f162-4f45-99e8-2de617e4c764 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.624962 Apr 12 12:33:56 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 119/353] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:33:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:33:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-12f87c94-4a71-4528-9811-e69dfecaf105 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:56 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-12f87c94-4a71-4528-9811-e69dfecaf105 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:33:56 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-12f87c94-4a71-4528-9811-e69dfecaf105 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-12f87c94-4a71-4528-9811-e69dfecaf105 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 200 len: 1222 microversion: 2.1 time: 0.076509 Apr 12 12:33:56 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 114/354] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:56 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:56 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:33:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-552910ad-521c-4ce9-8372-0e4ee5d2af9d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1491 microversion: 2.1 time: 0.159217 Apr 12 12:33:56 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 122/355] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:33:56 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1491 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:33:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:33:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:33:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:33:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:33:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] Creating event network-changed:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:33:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0dd09083-e1ce-4573-98f0-9579002747cb req-c77e30c4-8b18-4efd-99dc-f0c84b53860f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032890 Apr 12 12:33:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 120/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] Creating event network-vif-plugged:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9d8ed324-c832-4df2-b649-1935c09b0827 req-c7975494-6169-4415-ac0d-e3351534d950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141828 Apr 12 12:34:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 115/357] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=14 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=30 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] Creating event network-vif-plugged:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-5c517197-8147-44d3-8980-df53cfc92e49 req-606a7a4f-961b-46d7-ba73-bd352c64a662 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140963 Apr 12 12:34:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 123/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "76450ca6-4f7a-4e03-9269-feaacfced76a"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "76450ca6-4f7a-4e03-9269-feaacfced76a"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "5dfbb175-cb83-461e-91da-d7cbde98c3e6"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "5dfbb175-cb83-461e-91da-d7cbde98c3e6"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:76450ca6-4f7a-4e03-9269-feaacfced76a for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:76450ca6-4f7a-4e03-9269-feaacfced76a for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] Creating event network-vif-plugged:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f7c49275-70f6-4c2c-a42b-71e7bb573dd6 req-298d48ec-9697-4d74-b417-ddd1bcdee250 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.046369 Apr 12 12:34:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 12:34:07 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-35edd253-f437-42e0-a717-0dee95de1c86 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.155663 Apr 12 12:34:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 116/360] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:34:08 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:09 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Creating event network-vif-plugged:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Creating event network-vif-plugged:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] Creating event network-vif-plugged:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a36c70fe-abc4-42c7-a20f-19b8c666f459 req-dbac4b21-54e5-4909-b00b-6aae380023d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036275 Apr 12 12:34:09 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 124/361] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:09 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] Creating event network-vif-plugged:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:34:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-67fd7646-d4ae-4c45-bdd7-6106d02ddd0b req-8b14fa59-c284-4cdb-b6aa-cdb0d3a13963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038246 Apr 12 12:34:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "name": "network-vif-plugged", "status": "completed", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:11 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] Creating event network-vif-plugged:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:34:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-4cb32a2a-d153-4f51-b3ad-cc033fc747d2 req-f2ccd392-8fa8-4b3f-9041-3f0ed87925cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034475 Apr 12 12:34:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 117/363] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5afd002d-aa40-4787-a5c9-1abf9c0aac40"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:11 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] Creating event network-changed:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:34:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-2d3de974-2a24-4c97-b270-2fd4c28cb771 req-3ef66b1e-7b2f-4f31-ba3f-07147a9c9a67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029807 Apr 12 12:34:11 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 123/364] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-44dce9ee-7969-4f51-8737-8896a39237e9 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321042 Apr 12 12:34:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 125/365] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:34:11 2023] POST /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "name": "network-vif-plugged", "status": "completed", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] Creating event network-vif-plugged:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:34:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-05baada1-3ef7-4fa5-949c-d7c9b6625c0b req-f97f485a-08f2-4766-8824-1954e4eefe75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030751 Apr 12 12:34:13 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 118/366] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:14 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-eae61c15-f073-416c-8eeb-1846e66d9409 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.299559 Apr 12 12:34:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 124/367] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:14 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:15 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7591074e-3279-43c2-9dd1-293a46620c6d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.200580 Apr 12 12:34:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 126/368] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:15 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-19d8e646-f353-46c4-924c-8cbc8ffdd30b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049648 Apr 12 12:34:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 119/369] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:34:15 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b088551-bc20-40c9-92ea-610d0fa94bae"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:18 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a8f8f5c9-c82e-4c05-89c0-5039007cb9f6 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336408 Apr 12 12:34:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:34:18 2023] POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "047a0231-bc19-4e5c-8093-667edaa3884c"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ad136e8e-e29e-4d55-bb97-7f28ddafca08 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action" status: 202 len: 0 microversion: 2.1 time: 0.213167 Apr 12 12:34:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 120/371] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:34:19 2023] POST /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] HTTP exception thrown: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Request method failure captured: Apr 12 12:34:20 user devstack@n-api.service[61614]: request: PUT /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments/5afd002d-aa40-4787-a5c9-1abf9c0aac40 HTTP/1.1 Apr 12 12:34:20 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:34:20 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:34:20 user devstack@n-api.service[61614]: Connection: close Apr 12 12:34:20 user devstack@n-api.service[61614]: Content-Length: 74 Apr 12 12:34:20 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:34:20 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:34:20 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:34:20 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqTOFU3CZ3bcSjVPn8LOooJvn5LydNDqjrqDP8xVoW65Hfy7hYda7C6DU5OzNMhkQX13tn-EmGwGWcJ5R-9dUUpSLSLnK4XuMAFi9udWsNJIRL5z8i94lUYX1brmrFs8aikjvKs3qDmE-V1qPa0dW_46b5yLtTwLklzQdz40CljSvHk Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Project-Id: cf1701d3b23647e5bab90d28ee98ac14 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Role: admin,member,reader Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Roles: admin,member,reader Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Tenant-Id: cf1701d3b23647e5bab90d28ee98ac14 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:34:20 user devstack@n-api.service[61614]: X-User: tempest-VolumesAdminNegativeTest-693588654-project-admin Apr 12 12:34:20 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:34:20 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:34:20 user devstack@n-api.service[61614]: X-User-Id: d37c1dfdfcda424b823bd52790f92eca Apr 12 12:34:20 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesAdminNegativeTest-693588654-project-admin Apr 12 12:34:20 user devstack@n-api.service[61614]: Apr 12 12:34:20 user devstack@n-api.service[61614]: {"volumeAttachment": {"volumeId": "047a0231-bc19-4e5c-8093-667edaa3884c"}} Apr 12 12:34:20 user devstack@n-api.service[61614]: method: > Apr 12 12:34:20 user devstack@n-api.service[61614]: exception: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. Apr 12 12:34:20 user devstack@n-api.service[61614]: action_args: {'server_id': 'c5b9b1bb-a3d9-4073-8d49-70360dae6f29', 'id': '5afd002d-aa40-4787-a5c9-1abf9c0aac40', 'body': {'volumeAttachment': {'volumeId': '047a0231-bc19-4e5c-8093-667edaa3884c'}}} Apr 12 12:34:20 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. (HTTP 404) (Request-ID: req-82b100e6-7e01-4fb6-af40-ad9b2ffcdbaa) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. Apr 12 12:34:20 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Returning 400 to user: Volume 047a0231-bc19-4e5c-8093-667edaa3884c could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:34:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b249146c-919f-467b-992e-c6d68d5c4b8c tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments/5afd002d-aa40-4787-a5c9-1abf9c0aac40" status: 400 len: 107 microversion: 2.1 time: 0.336821 Apr 12 12:34:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 127/372] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 12:34:19 2023] PUT /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments/5afd002d-aa40-4787-a5c9-1abf9c0aac40 => generated 107 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:34:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5bcdcef9-7c48-4db9-9bca-d6f1c01f7760 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.110168 Apr 12 12:34:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:34:19 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lazy-loading 'services' on Instance uuid c5b9b1bb-a3d9-4073-8d49-70360dae6f29 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:34:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7f4c587a-e6e4-4a1f-8d07-9bcc263c0d24 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments/5afd002d-aa40-4787-a5c9-1abf9c0aac40" status: 202 len: 0 microversion: 2.1 time: 0.179322 Apr 12 12:34:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 121/374] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:34:20 2023] DELETE /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments/5afd002d-aa40-4787-a5c9-1abf9c0aac40 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-191914cb-ca3c-4739-9371-af316ed7fa2d tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068146 Apr 12 12:34:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 128/375] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:34:20 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] Creating event network-changed:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-2b34eb81-3eec-4e37-b671-3e2b100c63d5 req-9c4dc83e-3ba9-4ff1-bb06-84bca561f37f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Apr 12 12:34:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 127/376] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}, {"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}, {"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Creating event network-changed:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Creating event network-vif-unplugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-859f01fd-e198-4623-b53b-2ce27f78532e req-77e91627-c66f-4991-93b2-23a573270724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.031686 Apr 12 12:34:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 122/377] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:23 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}, {"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:34:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c30d4bfe-b0d2-470f-bc6b-4315c55ccd2b req-c71004ae-557c-4b04-a16c-8abda89b88bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029741 Apr 12 12:34:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 129/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:28 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:29 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'services' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:34:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-708e6c5d-9dd4-4303-b49e-7e69384fd198 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/6b088551-bc20-40c9-92ea-610d0fa94bae" status: 202 len: 0 microversion: 2.1 time: 0.206752 Apr 12 12:34:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 128/379] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:34:28 2023] DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/6b088551-bc20-40c9-92ea-610d0fa94bae => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4524d041-0775-4e2e-8c8b-d4a4284eba10 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049854 Apr 12 12:34:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 123/380] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:34:29 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] [instance: 49339083-8dd4-454b-b7aa-73d91238bef4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] HTTP exception thrown: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Request method failure captured: Apr 12 12:34:30 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 HTTP/1.1 Apr 12 12:34:30 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:34:30 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:34:30 user devstack@n-api.service[61614]: Connection: close Apr 12 12:34:30 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:34:30 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:34:30 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:34:30 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:34:30 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqSzOq9O0OdVVW5IQwicl5dgazqOBYtW0olfzR6SdcFiL35BPMKIl8_Lrga4hlflu2GSOc_P29Y_OQtPCwr6DyRGUL_Kid3agV2G2MotsBz-IRgs9xGksKeR7hoYQsquqrSqos2L2C044MmIu94_xEPCq_3CYS5rfib2M-Jfk97sxF0 Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Project-Id: 9cc629696bdf4ed2bc9da7e20e8102fb Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesNegativeTest-809350896 Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9cc629696bdf4ed2bc9da7e20e8102fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9cc629696bdf4ed2bc9da7e20e8102fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9cc629696bdf4ed2bc9da7e20e8102fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesNegativeTest-809350896 Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Tenant-Id: 9cc629696bdf4ed2bc9da7e20e8102fb Apr 12 12:34:30 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesNegativeTest-809350896 Apr 12 12:34:30 user devstack@n-api.service[61614]: X-User: tempest-VolumesNegativeTest-809350896-project-member Apr 12 12:34:30 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:34:30 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:34:30 user devstack@n-api.service[61614]: X-User-Id: ddeb0b1b08ba4cbcb08705c49517f43f Apr 12 12:34:30 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesNegativeTest-809350896-project-member Apr 12 12:34:30 user devstack@n-api.service[61614]: method: > Apr 12 12:34:30 user devstack@n-api.service[61614]: exception: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. Apr 12 12:34:30 user devstack@n-api.service[61614]: action_args: {'id': '49339083-8dd4-454b-b7aa-73d91238bef4'} Apr 12 12:34:30 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. Apr 12 12:34:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] Returning 404 to user: Instance 49339083-8dd4-454b-b7aa-73d91238bef4 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:34:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e98646b6-84f9-4446-aa22-a4652fa36b4b tempest-VolumesNegativeTest-809350896 tempest-VolumesNegativeTest-809350896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4" status: 404 len: 111 microversion: 2.1 time: 0.036494 Apr 12 12:34:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 130/381] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:30 2023] GET /compute/v2.1/servers/49339083-8dd4-454b-b7aa-73d91238bef4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:33 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0b985613-e9cd-4f6f-b369-340c1ec14c02 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 200 len: 2824 microversion: 2.42 time: 0.197876 Apr 12 12:34:33 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 129/382] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:34:33 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 2824 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:34:33 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:33 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-3df0a29e-5a80-493b-bcba-a366a76f111e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.107323 Apr 12 12:34:34 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 124/383] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:34:33 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:34:34 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] Creating event network-changed:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:34:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-74db3fba-9d09-42fc-92ed-c81c6cee5579 req-bc8eba87-8dae-4a73-bb2c-5baf35769f00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037704 Apr 12 12:34:34 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 131/384] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1bac6104-a992-4cf7-ba79-ccd921b549f2 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/ips" status: 200 len: 109 microversion: 2.20 time: 0.040415 Apr 12 12:34:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 130/385] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 12:34:34 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46234755-00e8-4256-9acd-7daa3980a5f4", "device": "/dev/vdb"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:35 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-39ccbcc2-7b7f-403a-a317-d6e8e0483388 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428477 Apr 12 12:34:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 125/386] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:34:35 2023] POST /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:36 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'flavor' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:34:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e48c5535-c987-410c-a848-6abcbc91aa41 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/action" status: 202 len: 0 microversion: 2.20 time: 0.964263 Apr 12 12:34:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 132/387] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:34:36 2023] POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:37 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3da30a16-772c-4b3e-9675-f79e5b1d4b04 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1710 microversion: 2.20 time: 0.187352 Apr 12 12:34:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 131/388] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:34:37 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:34:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-unplugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] Creating event network-vif-unplugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:34:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-a58ca6c4-94bf-432c-84c5-993451995fee req-ea41313d-b9e9-423d-8a6c-dd6da258923b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034212 Apr 12 12:34:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 126/389] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=21 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:39 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:34:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-40ee7c00-7a68-4b5e-a94a-6409c7b0230a req-32bcc0ba-ec07-4949-89c7-9920f1609146 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045432 Apr 12 12:34:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 133/390] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:42 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:42 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=22 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:42 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] Creating event network-changed:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:34:42 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-359aad4f-85ce-40f3-8cfe-c4f19ffc9249 req-4f22755d-ad8c-48d0-a127-addf302d7209 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034031 Apr 12 12:34:42 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 132/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=20 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:46 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-95b5633f-13bb-4299-a2d3-390c8e6f938f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 200 len: 1547 microversion: 2.1 time: 0.192809 Apr 12 12:34:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 127/392] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:46 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "731b8264-d545-493f-b177-0235573a7cee"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 10116da0-785c-41cf-96bb-95721af863db while it is in vm_state rescued Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Request method failure captured: Apr 12 12:34:50 user devstack@n-api.service[61614]: request: POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/os-volume_attachments HTTP/1.1 Apr 12 12:34:50 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:34:50 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:34:50 user devstack@n-api.service[61614]: Connection: close Apr 12 12:34:50 user devstack@n-api.service[61614]: Content-Length: 74 Apr 12 12:34:50 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:34:50 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:34:50 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:34:50 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPajtKreeen1BvBIukNq2K5bbAE4dQI4pcXQl4SrLk0qsljvifJsmSfn7qWZ3S9QTNAkC5zEscWQhQMgzZ0HKPefrSal9t_4fx76XBKSZMxu9qfg0YIRwx67buSlT1VmzOG-247FtoUg4U6aAHyZ03S78t-7XGs5SWONZ6wg-l1TLE Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Project-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Tenant-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:34:50 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:34:50 user devstack@n-api.service[61614]: X-User: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:34:50 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:34:50 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:34:50 user devstack@n-api.service[61614]: X-User-Id: 1db0203a6e6f4cc3bccbf19577a0c82f Apr 12 12:34:50 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:34:50 user devstack@n-api.service[61614]: Apr 12 12:34:50 user devstack@n-api.service[61614]: {"volumeAttachment": {"volumeId": "731b8264-d545-493f-b177-0235573a7cee"}} Apr 12 12:34:50 user devstack@n-api.service[61614]: method: > Apr 12 12:34:50 user devstack@n-api.service[61614]: exception: Cannot 'attach_volume' instance 10116da0-785c-41cf-96bb-95721af863db while it is in vm_state rescued Apr 12 12:34:50 user devstack@n-api.service[61614]: action_args: {'server_id': '10116da0-785c-41cf-96bb-95721af863db', 'body': {'volumeAttachment': {'volumeId': '731b8264-d545-493f-b177-0235573a7cee'}}} Apr 12 12:34:50 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10116da0-785c-41cf-96bb-95721af863db in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 10116da0-785c-41cf-96bb-95721af863db while it is in vm_state rescued Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 10116da0-785c-41cf-96bb-95721af863db while it is in vm_state rescued Apr 12 12:34:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:34:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Returning 409 to user: Cannot 'attach_volume' instance 10116da0-785c-41cf-96bb-95721af863db while it is in vm_state rescued {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:34:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-581a3ab8-342a-419e-9aca-d93460aaa43e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071847 Apr 12 12:34:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 134/393] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:34:50 2023] POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7354fce0-e94e-4edc-a555-762fabf5512a tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/action" status: 202 len: 0 microversion: 2.1 time: 0.149231 Apr 12 12:34:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 133/394] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:34:50 2023] POST /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:51 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2a956ea9-1f20-4cd4-a7c9-8768c1031128 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1498 microversion: 2.1 time: 0.301580 Apr 12 12:34:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 128/395] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:51 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-unplugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] Creating event network-vif-unplugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:34:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f834a4f7-4499-48c7-80ab-c2a1db383cd4 req-7e657606-39a1-4dc9-b0ad-bd1b06853966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033682 Apr 12 12:34:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 135/396] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-65ae3d7e-ca11-469d-a73e-50278abcbe6c tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Action: 'create', calling method: .version_select at 0x7fc95d42ecb0>, body: {"keypair": {"name": "tempest-TestShelveInstance-568010420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXMDy37+J0z2zjXuZ61N5MrklsBTrLDHZ5WONUVRavY0GPTGKIiOPe6k/JrTv4Yj3TrMCnYedVgrFp1+M+iVBHHlbm5MUjkvlQ73cuxRdVBOG/e8rbEfvGvKpVaF3RRQ=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:53 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-65ae3d7e-ca11-469d-a73e-50278abcbe6c tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting quotas for project 99a894beccbd45af9d4486772fccb949. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:34:53 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-65ae3d7e-ca11-469d-a73e-50278abcbe6c tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting quotas for user b4b62db7ef8e4ae4bc11ff520c6afcd8 and project 99a894beccbd45af9d4486772fccb949. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:34:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-65ae3d7e-ca11-469d-a73e-50278abcbe6c tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.280742 Apr 12 12:34:53 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 134/397] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:34:52 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lazy-loading 'services' on Instance uuid 839e85a2-f7af-482d-a5e6-09195888300e {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:34:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-62bf8ffa-313d-441c-8819-5aa244aa09ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments/e2586924-e0c3-4908-8f2c-7375bf258d7f" status: 202 len: 0 microversion: 2.1 time: 0.294730 Apr 12 12:34:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 129/398] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:34:53 2023] DELETE /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments/e2586924-e0c3-4908-8f2c-7375bf258d7f => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e0f52a21-19c7-4025-b24d-c9c4eb06baff tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084289 Apr 12 12:34:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 136/399] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:34:54 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:34:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-1659c23f-0755-4863-a7d0-d6140c0c597c req-fd605534-04a5-4714-99cc-2f6bc44443be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036437 Apr 12 12:34:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lazy-loading 'services' on Instance uuid 4b597d03-8252-4e26-a5a9-651117bf78d1 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:34:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f5701cd4-3d2f-4363-aa4c-b56e49c26601 tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1/os-volume_attachments/46234755-00e8-4256-9acd-7daa3980a5f4" status: 202 len: 0 microversion: 2.1 time: 0.170505 Apr 12 12:34:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 130/401] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:34:54 2023] DELETE /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1/os-volume_attachments/46234755-00e8-4256-9acd-7daa3980a5f4 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:34:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2b26fc71-ad00-458f-a617-d45d0f45956f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1" status: 204 len: 0 microversion: 2.1 time: 0.155574 Apr 12 12:34:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 137/402] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:34:54 2023] DELETE /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:55 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35727e3b48da4494808015e2b630a3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466d2a494cf64002a98588909bdcd197', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:55 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-29182113-0dcd-4779-8336-af8b8ecf799a tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1" status: 200 len: 1547 microversion: 2.1 time: 0.182528 Apr 12 12:34:55 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 136/403] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:55 2023] GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}, {"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:34:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:34:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-02344277-b25b-4829-b856-bb7da2e16870 req-220c910c-763e-468d-977b-d0127270040d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034545 Apr 12 12:34:56 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 131/404] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900654939", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:56 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] validate_networks() for [('963759e8-808d-494c-9dea-0efa9f78804a', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting quotas for project 7ab04e4f968f4c07af43f3fe6651713a. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Getting quotas for user bc42504b7aab4fedb136acd998adeddb and project 7ab04e4f968f4c07af43f3fe6651713a. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:34:57 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:34:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3ac86e7c-6bfc-42c9-8aa0-108fa9470cb1 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.615371 Apr 12 12:34:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 138/405] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:34:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:34:57 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9063893e-f9a9-4b15-b692-00273445c52d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:57 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9063893e-f9a9-4b15-b692-00273445c52d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:57 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-9063893e-f9a9-4b15-b692-00273445c52d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9063893e-f9a9-4b15-b692-00273445c52d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 200 len: 1211 microversion: 2.1 time: 0.076176 Apr 12 12:34:57 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:57 2023] GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 1211 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:34:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "name": "network-vif-unplugged", "status": "completed", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] Creating event network-vif-unplugged:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:34:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-6bc6a786-b2ca-40d0-b43e-162c3bce6979 req-1f2c9964-3a3f-4652-a461-49fe149bc39a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036546 Apr 12 12:34:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 132/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:34:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-224414802", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-568010420", "security_groups": [{"name": "tempest-secgroup-smoke-1119513681"}], "networks": [{"uuid": "34ecf1c9-50ff-4168-8650-a5277102ccaa"}], "block_device_mapping_v2": [{"uuid": "5edf56f8-c348-40e5-a9e0-d0b3a7fc7945", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] validate_networks() for [('34ecf1c9-50ff-4168-8650-a5277102ccaa', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting quotas for project 99a894beccbd45af9d4486772fccb949. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Getting quotas for user b4b62db7ef8e4ae4bc11ff520c6afcd8 and project 99a894beccbd45af9d4486772fccb949. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:34:59 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5edf56f8-c348-40e5-a9e0-d0b3a7fc7945',volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:34:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7b9c3e2d-1d7d-4c37-ad7b-2e5600ac0ea5 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.840063 Apr 12 12:34:59 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 139/408] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:34:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:34:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5ab06061-1500-4094-b923-84aeb650e5f9 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:34:59 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5ab06061-1500-4094-b923-84aeb650e5f9 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:34:59 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-5ab06061-1500-4094-b923-84aeb650e5f9 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:34:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5ab06061-1500-4094-b923-84aeb650e5f9 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1082 microversion: 2.1 time: 0.065735 Apr 12 12:34:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 138/409] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:34:59 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1082 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "name": "network-vif-deleted", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] Creating event network-vif-deleted:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:35:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3f16dca4-7b4f-4ff1-866d-cce1a6fd394b req-d7a74b85-6c70-4fb5-a1b0-8d814021be36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035203 Apr 12 12:35:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 133/410] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b597d03-8252-4e26-a5a9-651117bf78d1", "name": "network-vif-plugged", "status": "completed", "tag": "77d477e8-bd8b-4918-af70-09d64ecf39d5"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] Creating event network-vif-plugged:77d477e8-bd8b-4918-af70-09d64ecf39d5 for instance 4b597d03-8252-4e26-a5a9-651117bf78d1 on user Apr 12 12:35:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-44f3e320-cf23-43ed-be4a-77a4a85bfc8f req-82e3760a-c9b1-4438-87af-319df35de670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036520 Apr 12 12:35:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 140/411] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:02 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] Creating event network-changed:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:35:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-332043c1-49ce-4142-93df-67f471689d45 req-c0448ba0-f81c-4b98-a2df-9fe0717b4f17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Apr 12 12:35:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "name": "network-vif-plugged", "status": "completed", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] Creating event network-vif-plugged:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:35:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-c4e91db2-233d-4f85-9413-169db4cdd68b req-68259f01-150e-4698-ad98-d6171fc9d254 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Apr 12 12:35:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 134/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] Creating event network-changed:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:35:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-907eaa38-dab7-453b-a6a1-5907060b2ee4 req-3a9b7afc-55df-4ac0-9db3-cede63a4db64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030615 Apr 12 12:35:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 141/414] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "name": "network-vif-plugged", "status": "completed", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] Creating event network-vif-plugged:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:35:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-058ea73e-f528-4faf-84ae-f440ea15d57f req-f725d268-a8d6-40eb-bb56-0a87764cd908 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034875 Apr 12 12:35:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 140/415] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:09 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:35:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-4b4994d4-3473-48c8-b597-412af4935355 req-fb8ee419-dd8f-4f87-bd6e-6641f9b40013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050239 Apr 12 12:35:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 135/416] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4f7f448e-997d-43f2-a0dd-b5eadc36f7c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085467 Apr 12 12:35:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 142/417] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:35:10 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:35:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-844880205", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "6e43ca53-1563-43b0-84cc-d3f759c61c37"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:10 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] validate_networks() for [('6e43ca53-1563-43b0-84cc-d3f759c61c37', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for project 7d607e0aed1f47129540181261c6ebc7. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Getting quotas for user b3a887c10bf74974a648e3ec048fcdd7 and project 7d607e0aed1f47129540181261c6ebc7. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:35:11 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:35:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fc4601a3-c1f2-40ef-8f69-a5a6ffd29826 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.493770 Apr 12 12:35:11 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 141/418] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:35:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:35:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2a187b83-fde8-4234-a4f3-026ca23189c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2a187b83-fde8-4234-a4f3-026ca23189c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-2a187b83-fde8-4234-a4f3-026ca23189c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2a187b83-fde8-4234-a4f3-026ca23189c5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad" status: 200 len: 1211 microversion: 2.1 time: 0.069323 Apr 12 12:35:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 136/419] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:11 2023] GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad => generated 1211 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:35:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f700298f-f187-44a8-a55e-d893465b5e6b req-e12bb539-a659-426c-a09e-849a134f791c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Apr 12 12:35:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 143/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] Creating event network-changed:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:35:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-b4b7a161-a336-44b0-9083-a88446c0f334 req-cc8d6d64-9bff-4d75-9803-600c6ed919a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Apr 12 12:35:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:15 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lazy-loading 'services' on Instance uuid 546c0c08-35f1-4043-ac30-56d49bc86af1 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:35:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a2fca8f6-1b75-4984-852b-bae47c970128 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments/a2a363ad-a0a5-4076-9530-5488fad60936" status: 202 len: 0 microversion: 2.1 time: 0.191998 Apr 12 12:35:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 137/422] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:35:15 2023] DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments/a2a363ad-a0a5-4076-9530-5488fad60936 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-07bce934-eb35-41b8-9293-09d52d4997a6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059006 Apr 12 12:35:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 144/423] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:35:15 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:35:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "name": "network-vif-plugged", "status": "completed", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] Creating event network-vif-plugged:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:35:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-64d0909c-742d-4a19-a7a7-9fe7915b0226 req-5947feae-92f9-4656-ab03-f259f00caefe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036870 Apr 12 12:35:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 143/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "name": "network-vif-plugged", "status": "completed", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:18 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=24 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] Creating event network-vif-plugged:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:35:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-c7341168-5c17-4754-b22b-0f875edfe16b req-7104e328-c123-4f6d-8ac7-cb6b835faf1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Apr 12 12:35:18 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 138/425] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1dd9388c-b88e-4860-b04d-23f4bbb4226f tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178597 Apr 12 12:35:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 145/426] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:35:19 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6674cb31-cc82-4f02-97db-d65b7c87c844"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-49328c7b-cd8b-4f6d-a582-42a21b24cfc7 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347721 Apr 12 12:35:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 144/427] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:35:22 2023] POST /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:27 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-73e57b90-20a4-4979-9c0f-b8b93b9be383 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1651 microversion: 2.20 time: 0.189804 Apr 12 12:35:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 139/428] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:35:27 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1651 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:30 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lazy-loading 'services' on Instance uuid d584edf2-12e3-48d1-947f-fdfb0c9c7377 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:35:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8f2fb1c8-5214-4749-af78-81fea6f1d038 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/6674cb31-cc82-4f02-97db-d65b7c87c844" status: 202 len: 0 microversion: 2.1 time: 0.183029 Apr 12 12:35:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 146/429] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:35:30 2023] DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments/6674cb31-cc82-4f02-97db-d65b7c87c844 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a1908391-d4c0-4e07-b569-7e7f2011465b tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070341 Apr 12 12:35:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:35:31 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d52e6b13-c6dd-4942-9434-cb92dbb8c660 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.125150 Apr 12 12:35:34 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 140/431] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:35:34 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/os-interface => generated 1829 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:35:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] Creating event network-changed:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-3bb77003-5756-4ecf-a723-c8d0e0d73edc req-400fa435-b4a8-4a6d-9324-0b789c4effe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 Apr 12 12:35:35 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 147/432] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:35 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-77672d4c-1eac-4231-9050-70fa11213e15 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 200 len: 2824 microversion: 2.42 time: 0.226959 Apr 12 12:35:35 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 146/433] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:35:35 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 2824 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:35 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-239e7456-af12-4e46-ab0b-64520eaaa45a tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.153246 Apr 12 12:35:35 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 141/434] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:35:35 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa/os-interface => generated 1829 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:35:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c04360d1-0d4f-493a-8dd8-207e9ad27042 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 204 len: 0 microversion: 2.42 time: 0.126143 Apr 12 12:35:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 148/435] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:35:36 2023] DELETE /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:36 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e17bc9d4cf743c19f9493d30b62fc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f89f1f2dba8e4325b550ad91403e60ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-49e12431-88d3-4244-bea8-04fb920bd34c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 200 len: 2949 microversion: 2.42 time: 0.260955 Apr 12 12:35:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 147/436] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:35:36 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 2949 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 12:35:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] Creating event network-vif-unplugged:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-ac9335c9-5f4c-4948-9b8d-22b626f8f0a1 req-bd54edd0-e235-4ee7-8c6b-9b25aaee0749 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041028 Apr 12 12:35:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 142/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] Creating event network-vif-unplugged:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1730949b-ba37-478b-b40f-159f90491e37 req-aa764b35-7d16-46f2-92d7-07043775216c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035828 Apr 12 12:35:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 149/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "76450ca6-4f7a-4e03-9269-feaacfced76a"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "76450ca6-4f7a-4e03-9269-feaacfced76a"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "5dfbb175-cb83-461e-91da-d7cbde98c3e6"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "5dfbb175-cb83-461e-91da-d7cbde98c3e6"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-plugged:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-unplugged:76450ca6-4f7a-4e03-9269-feaacfced76a for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-plugged:76450ca6-4f7a-4e03-9269-feaacfced76a for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-unplugged:5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-plugged:5dfbb175-cb83-461e-91da-d7cbde98c3e6 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-unplugged:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-plugged:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-unplugged:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] Creating event network-vif-plugged:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0012898e-84ad-4222-bafe-48fee5cad9c8 req-82ae33d9-d897-4c6c-9a86-d5580fcf7c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1559 microversion: 2.1 time: 0.037685 Apr 12 12:35:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 148/439] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 12:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 1559 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-unplugged", "status": "completed", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-plugged", "status": "completed", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Creating event network-vif-plugged:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Creating event network-vif-unplugged:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] Creating event network-vif-plugged:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-4dff8140-c171-4108-835f-104f165801de req-32a1a639-210a-4eb4-89b2-f3c8beee408d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034528 Apr 12 12:35:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 143/440] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:35:41 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-deleted", "tag": "501229b8-6d04-45a8-97df-927b8ec14ca3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] Creating event network-vif-deleted:501229b8-6d04-45a8-97df-927b8ec14ca3 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-7f03c25c-dceb-4f5d-a3a4-42a3c096c33f req-a34a20e3-122f-459a-a237-5fa42d753eac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Apr 12 12:35:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 150/441] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:41 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9cf37711-7eb2-4d49-934b-1b9d424b3e3c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1504 microversion: 2.1 time: 0.204426 Apr 12 12:35:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:41 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-deleted", "tag": "94f43c42-9d4d-4625-b558-4be918b78ffb"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-deleted", "tag": "bad3a184-db6f-4d2d-ac53-f1155fcf0fe1"}, {"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-deleted", "tag": "4a995fb4-7c9a-443c-a66a-47c04d7862ea"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Creating event network-vif-deleted:94f43c42-9d4d-4625-b558-4be918b78ffb for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Creating event network-vif-deleted:bad3a184-db6f-4d2d-ac53-f1155fcf0fe1 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] Creating event network-vif-deleted:4a995fb4-7c9a-443c-a66a-47c04d7862ea for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-8004c26d-d0b4-49aa-b2bc-c046cdfeff5a req-f41ce755-fa60-46ad-9826-7e686ad3f580 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038285 Apr 12 12:35:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 144/443] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:43 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:44 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d8b776a9-22bc-4727-9a2d-6eaeb4903d0c tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047877 Apr 12 12:35:44 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 151/444] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:35:44 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] [instance: 4b597d03-8252-4e26-a5a9-651117bf78d1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=16 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] HTTP exception thrown: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Request method failure captured: Apr 12 12:35:45 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 HTTP/1.1 Apr 12 12:35:45 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:35:45 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:35:45 user devstack@n-api.service[61615]: Connection: close Apr 12 12:35:45 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:35:45 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:35:45 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:35:45 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:35:45 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQkRJEry3bzlhA6Lakva2SnUhnNOpBjm2uXMAoA3lQKvfrGxQVZFv4biWQXqoT3Gy0d_IURt-ScSSOu5E-qpR3SHizSoOrY1M1P90lXO7gKWhzhhPwzbjZJmkVf_WtcIxCrx3HQ_1qFwAzh2HuqdM_bNZxANxSFmBa2nJ4d5dWPUoc Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Project-Id: 466d2a494cf64002a98588909bdcd197 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/466d2a494cf64002a98588909bdcd197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/466d2a494cf64002a98588909bdcd197"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/466d2a494cf64002a98588909bdcd197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Tenant-Id: 466d2a494cf64002a98588909bdcd197 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-760244133 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-User: tempest-VolumesSnapshotTestJSON-760244133-project-member Apr 12 12:35:45 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:35:45 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:35:45 user devstack@n-api.service[61615]: X-User-Id: 35727e3b48da4494808015e2b630a3f9 Apr 12 12:35:45 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesSnapshotTestJSON-760244133-project-member Apr 12 12:35:45 user devstack@n-api.service[61615]: method: > Apr 12 12:35:45 user devstack@n-api.service[61615]: exception: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. Apr 12 12:35:45 user devstack@n-api.service[61615]: action_args: {'id': '4b597d03-8252-4e26-a5a9-651117bf78d1'} Apr 12 12:35:45 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. Apr 12 12:35:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:35:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] Returning 404 to user: Instance 4b597d03-8252-4e26-a5a9-651117bf78d1 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:35:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c4f433c3-85c2-4398-a6f2-4fdd9c9abc4f tempest-VolumesSnapshotTestJSON-760244133 tempest-VolumesSnapshotTestJSON-760244133-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1" status: 404 len: 111 microversion: 2.1 time: 0.044543 Apr 12 12:35:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:45 2023] GET /compute/v2.1/servers/4b597d03-8252-4e26-a5a9-651117bf78d1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:35:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81cb942b-5bd6-47c4-8130-f5a4d17f10fa", "name": "network-vif-deleted", "tag": "e59fa8d8-7765-453d-a135-0abe5f1cae78"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] Creating event network-vif-deleted:e59fa8d8-7765-453d-a135-0abe5f1cae78 for instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa on user Apr 12 12:35:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-a5c274b7-5f22-4270-8240-191f13d05796 req-bb93e7ec-3f8e-4707-bbb8-7bbd42d0f8c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049807 Apr 12 12:35:45 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 145/446] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-efeab77f-6bae-4e9e-835c-5ea0ae3a47ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '.version_select at 0x7fc95d5849d0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-de37c71c-b972-45f5-bdf6-43e1f978022d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 200 len: 1547 microversion: 2.1 time: 0.175610 Apr 12 12:35:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 152/447] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:46 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:35:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-efeab77f-6bae-4e9e-835c-5ea0ae3a47ae tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce" status: 204 len: 0 microversion: 2.1 time: 0.242756 Apr 12 12:35:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 151/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:46 2023] DELETE /compute/v2.1/images/1a7cdce6-23be-41d4-a5cc-e9053f94d2ce => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:35:47 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2ab18295-12a5-44d5-a2c9-7b32c10d9b98 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 204 len: 0 microversion: 2.1 time: 0.149360 Apr 12 12:35:47 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 146/449] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:35:46 2023] DELETE /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5019f563-ac61-4a5b-a950-179401c95ce6 tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 204 len: 0 microversion: 2.1 time: 0.143674 Apr 12 12:35:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 153/450] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:35:46 2023] DELETE /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-aecc29c0-8287-4310-a177-946df713fb33 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 200 len: 1553 microversion: 2.1 time: 0.332536 Apr 12 12:35:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 152/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:47 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 1553 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76f02dd70664dfea34586abbc213526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1faa529d424800900e10a7ceaa63d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:47 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d7878455-9062-4a2b-9d5d-8eba7435d63d tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 200 len: 1677 microversion: 2.1 time: 0.306938 Apr 12 12:35:47 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 147/452] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:47 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "name": "network-vif-unplugged", "status": "completed", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] Creating event network-vif-unplugged:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:35:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-aad3e7a2-1bb8-4bc0-8a57-88a1f955d0d8 req-cb2c60f9-e2ec-46ae-bbf1-fd4048b3336b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055286 Apr 12 12:35:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 153/453] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.131s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] Creating event network-vif-unplugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:35:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-86d31c06-a7b4-4db6-b687-fe0315697eed req-2fc2c818-8775-4e6b-b5d8-5b66ecd86d64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186193 Apr 12 12:35:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 148/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:48 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-9f0a1bf7-85cc-473c-9106-2b6f2603ba9f tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 200 len: 1493 microversion: 2.1 time: 0.716897 Apr 12 12:35:48 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:47 2023] GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 1493 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:35:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "name": "network-vif-plugged", "status": "completed", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}, {"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-deleted", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Creating event network-vif-plugged:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:35:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] Creating event network-vif-deleted:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:35:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-2f6dae37-793c-4b87-9788-70589b1a27dc req-3b0b8e8c-bf34-4668-ae38-73543feb285f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039241 Apr 12 12:35:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 154/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839e85a2-f7af-482d-a5e6-09195888300e", "name": "network-vif-plugged", "status": "completed", "tag": "b5f18af0-544d-4978-b20e-85da7e880834"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:50 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:35:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-3a090148-d4b7-4c8a-b6c1-4405419639c3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1433 microversion: 2.1 time: 0.205368 Apr 12 12:35:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 149/457] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:35:49 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1433 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:35:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] Creating event network-vif-plugged:b5f18af0-544d-4978-b20e-85da7e880834 for instance 839e85a2-f7af-482d-a5e6-09195888300e on user Apr 12 12:35:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-4127a144-caac-48fe-a41c-b18d4bcf67c4 req-3826af77-5b19-4d2b-92b0-073fad0c3e71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034767 Apr 12 12:35:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 155/458] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:35:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239b22bb-d381-4bd3-9b73-642f174d7664", "name": "network-vif-deleted", "tag": "593b7bab-955d-417a-88c5-6016acf5efe6"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:35:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:35:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:35:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:35:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] Creating event network-vif-deleted:593b7bab-955d-417a-88c5-6016acf5efe6 for instance 239b22bb-d381-4bd3-9b73-642f174d7664 on user Apr 12 12:35:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-30bd10d8-d870-4cf6-9c77-8a613073bf9e req-ad3e6e0d-10d9-4471-9e92-5e676116b887 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041500 Apr 12 12:35:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 155/459] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:35:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:01 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9ab6b419-d8ec-4f0e-9d76-677f08b0dd72 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad" status: 200 len: 1494 microversion: 2.1 time: 0.170270 Apr 12 12:36:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 150/460] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:01 2023] GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad => generated 1494 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:05 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:05 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d6719fc1-7546-4474-84cd-5b57b04fb42e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054043 Apr 12 12:36:05 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 156/461] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:36:05 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=33 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:06 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5af8cea9-2c9f-49bd-b119-9d1ad1cd201e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1678 microversion: 2.1 time: 0.195725 Apr 12 12:36:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 156/462] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:05 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:06 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:06 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d4feeb37-4b12-4dcf-b28e-a109fa4941e6 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1678 microversion: 2.1 time: 0.167871 Apr 12 12:36:06 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 151/463] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:06 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:06 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-08549c1f-d64f-4ef1-b5dc-7fe8e7cd3782 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1678 microversion: 2.1 time: 0.161767 Apr 12 12:36:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 157/464] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:06 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a9a33a8d-824c-4b4e-a2ab-14417b3877f2 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047226 Apr 12 12:36:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 157/465] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:36:21 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HTTP exception thrown: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Request method failure captured: Apr 12 12:36:27 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa HTTP/1.1 Apr 12 12:36:27 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:36:27 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:36:27 user devstack@n-api.service[61616]: Connection: close Apr 12 12:36:27 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:36:27 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:36:27 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:36:27 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:36:27 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqURavcyX1qn-cC3-KAiJ5R3peJ_FkTPiO-2N5IjdVKysEPPF5qvDCFt4w90h2iIIOHtCKWCA9CAkFGfSabs5rSJiyJMvmphJ9bX7OmULQduPfnVyGs9arG3FBDezlYnbwSKJ2Q_O9S2EHDiL3vk6kHgBQyFOe7NJWRM8sFdg7382Wk Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Project-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Tenant: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Tenant-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:27 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-User: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:27 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:36:27 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:36:27 user devstack@n-api.service[61616]: X-User-Id: 5e17bc9d4cf743c19f9493d30b62fc16 Apr 12 12:36:27 user devstack@n-api.service[61616]: X-User-Name: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:27 user devstack@n-api.service[61616]: method: > Apr 12 12:36:27 user devstack@n-api.service[61616]: exception: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:27 user devstack@n-api.service[61616]: action_args: {'id': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'} Apr 12 12:36:27 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:27 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Returning 404 to user: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:36:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b98ff34a-c6b4-406d-9d02-b9f257c7391c tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 404 len: 111 microversion: 2.42 time: 0.037357 Apr 12 12:36:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 152/466] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:36:26 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:36:27 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-62fcf1c2-fcac-4152-8b4d-58b62ff901d0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '.version_select at 0x7fc95d5a9870>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:27 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:27 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:27 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-62fcf1c2-fcac-4152-8b4d-58b62ff901d0 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067665587" status: 204 len: 0 microversion: 2.42 time: 0.029208 Apr 12 12:36:27 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 158/467] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 12:36:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067665587 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9c08f12-a467-4152-a8fb-00aef87ac9c9"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:28 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-78fdcd9c-fda2-43e4-b0f1-7b9158dc796b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344226 Apr 12 12:36:28 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 158/468] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 12:36:27 2023] POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61616) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 12:36:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fd9a9b9a-264b-40bb-9a51-78c642760e7b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/action" status: 202 len: 0 microversion: 2.20 time: 0.191377 Apr 12 12:36:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 153/469] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:36:28 2023] POST /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:28 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e0567473-6059-445e-9969-3fd23004c13b tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1737 microversion: 2.20 time: 0.201580 Apr 12 12:36:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 159/470] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:36:28 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HTTP exception thrown: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Request method failure captured: Apr 12 12:36:30 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa HTTP/1.1 Apr 12 12:36:30 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:36:30 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:36:30 user devstack@n-api.service[61615]: Connection: close Apr 12 12:36:30 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:36:30 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:36:30 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:36:30 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:36:30 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqURavcyX1qn-cC3-KAiJ5R3peJ_FkTPiO-2N5IjdVKysEPPF5qvDCFt4w90h2iIIOHtCKWCA9CAkFGfSabs5rSJiyJMvmphJ9bX7OmULQduPfnVyGs9arG3FBDezlYnbwSKJ2Q_O9S2EHDiL3vk6kHgBQyFOe7NJWRM8sFdg7382Wk Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Project-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Tenant: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Tenant-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:30 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-User: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:30 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:36:30 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:36:30 user devstack@n-api.service[61615]: X-User-Id: 5e17bc9d4cf743c19f9493d30b62fc16 Apr 12 12:36:30 user devstack@n-api.service[61615]: X-User-Name: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:30 user devstack@n-api.service[61615]: method: > Apr 12 12:36:30 user devstack@n-api.service[61615]: exception: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61615]: action_args: {'id': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'} Apr 12 12:36:30 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Returning 404 to user: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:36:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8c326abc-f2f2-49d9-afbf-e9aa204be8b8 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 404 len: 111 microversion: 2.42 time: 0.045630 Apr 12 12:36:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 159/471] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:36:30 2023] DELETE /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] [instance: 81cb942b-5bd6-47c4-8130-f5a4d17f10fa] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] HTTP exception thrown: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Request method failure captured: Apr 12 12:36:30 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa HTTP/1.1 Apr 12 12:36:30 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:36:30 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:36:30 user devstack@n-api.service[61616]: Connection: close Apr 12 12:36:30 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:36:30 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:36:30 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:36:30 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:36:30 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqURavcyX1qn-cC3-KAiJ5R3peJ_FkTPiO-2N5IjdVKysEPPF5qvDCFt4w90h2iIIOHtCKWCA9CAkFGfSabs5rSJiyJMvmphJ9bX7OmULQduPfnVyGs9arG3FBDezlYnbwSKJ2Q_O9S2EHDiL3vk6kHgBQyFOe7NJWRM8sFdg7382Wk Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Project-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f89f1f2dba8e4325b550ad91403e60ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Tenant: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Tenant-Id: f89f1f2dba8e4325b550ad91403e60ad Apr 12 12:36:30 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-602948185 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-User: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:30 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:36:30 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:36:30 user devstack@n-api.service[61616]: X-User-Id: 5e17bc9d4cf743c19f9493d30b62fc16 Apr 12 12:36:30 user devstack@n-api.service[61616]: X-User-Name: tempest-TaggedBootDevicesTest_v242-602948185-project-member Apr 12 12:36:30 user devstack@n-api.service[61616]: method: > Apr 12 12:36:30 user devstack@n-api.service[61616]: exception: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61616]: action_args: {'id': '81cb942b-5bd6-47c4-8130-f5a4d17f10fa'} Apr 12 12:36:30 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. Apr 12 12:36:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] Returning 404 to user: Instance 81cb942b-5bd6-47c4-8130-f5a4d17f10fa could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:36:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-341388bb-eba7-4ab6-a9c9-3ae4e5335601 tempest-TaggedBootDevicesTest_v242-602948185 tempest-TaggedBootDevicesTest_v242-602948185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa" status: 404 len: 111 microversion: 2.42 time: 0.041908 Apr 12 12:36:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 154/472] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:36:30 2023] GET /compute/v2.1/servers/81cb942b-5bd6-47c4-8130-f5a4d17f10fa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:36:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] Creating event network-changed:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:36:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-421768f7-cdad-4556-950f-fe2a5c9de68e req-9ef41591-4104-4255-865d-d0bcdd29afc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Apr 12 12:36:35 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 160/473] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] Creating event network-changed:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:36:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0c75234c-a64d-4fd3-8b6a-ef943c938bbd req-fdbe9410-500d-4423-b5e6-8970912686c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Apr 12 12:36:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 160/474] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:36:37 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 HTTP/1.1 Apr 12 12:36:37 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:36:37 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:36:37 user devstack@n-api.service[61616]: Connection: close Apr 12 12:36:37 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:36:37 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:36:37 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:36:37 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:36:37 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:36:37 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:36:37 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:36:37 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:36:37 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:36:37 user devstack@n-api.service[61616]: method: > Apr 12 12:36:37 user devstack@n-api.service[61616]: exception: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:36:37 user devstack@n-api.service[61616]: action_args: {'id': '239b22bb-d381-4bd3-9b73-642f174d7664'} Apr 12 12:36:37 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:36:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:36:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-0cbcb8af-e6df-4600-9457-d471734e3e85 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 404 len: 111 microversion: 2.1 time: 0.035274 Apr 12 12:36:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 155/475] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:37 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] [instance: 839e85a2-f7af-482d-a5e6-09195888300e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] HTTP exception thrown: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Request method failure captured: Apr 12 12:36:37 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e HTTP/1.1 Apr 12 12:36:37 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:36:37 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:36:37 user devstack@n-api.service[61614]: Connection: close Apr 12 12:36:37 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:36:37 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:36:37 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:36:37 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:36:37 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPmbaMpJBhK_Z6Ws1-dmdH2yE9RlJkaPp3JXWtbyurYp1cCoLQ6XT5cextTynsxK6Sh87Prio4xU5zKzCDMkdEO8qBjuYGKw4Ajdky6lwVClhpQ8yv5mWA66v4Kq78IevZDGDb9ORRciSUb0We5oHN1-wZQY4d1JfOmCFsZjYbUdX0 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Project-Id: 3b1faa529d424800900e10a7ceaa63d4 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1967261752 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b1faa529d424800900e10a7ceaa63d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b1faa529d424800900e10a7ceaa63d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b1faa529d424800900e10a7ceaa63d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerStableDeviceRescueTest-1967261752 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Tenant-Id: 3b1faa529d424800900e10a7ceaa63d4 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1967261752 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-User: tempest-ServerStableDeviceRescueTest-1967261752-project-member Apr 12 12:36:37 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:36:37 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:36:37 user devstack@n-api.service[61614]: X-User-Id: d76f02dd70664dfea34586abbc213526 Apr 12 12:36:37 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerStableDeviceRescueTest-1967261752-project-member Apr 12 12:36:37 user devstack@n-api.service[61614]: method: > Apr 12 12:36:37 user devstack@n-api.service[61614]: exception: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. Apr 12 12:36:37 user devstack@n-api.service[61614]: action_args: {'id': '839e85a2-f7af-482d-a5e6-09195888300e'} Apr 12 12:36:37 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. Apr 12 12:36:37 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Returning 404 to user: Instance 839e85a2-f7af-482d-a5e6-09195888300e could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:36:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d262d1b9-4d96-4380-8694-a9f933608bbe tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e" status: 404 len: 111 microversion: 2.1 time: 0.045494 Apr 12 12:36:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 161/476] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:37 2023] GET /compute/v2.1/servers/839e85a2-f7af-482d-a5e6-09195888300e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:36:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-77d6027c-f797-4ee2-af9b-b50e88f26ffd tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] Calling method '.version_select at 0x7fc95d34f640>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-77d6027c-f797-4ee2-af9b-b50e88f26ffd tempest-ServerStableDeviceRescueTest-1967261752 tempest-ServerStableDeviceRescueTest-1967261752-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613417814" status: 202 len: 0 microversion: 2.1 time: 0.027675 Apr 12 12:36:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 161/477] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:36:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613417814 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:36:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e8760cdc-9893-477f-afb1-bd9626caf708 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 204 len: 0 microversion: 2.1 time: 0.170039 Apr 12 12:36:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 156/478] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:36:37 2023] DELETE /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:38 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272654f6bbb4fb39b3c334c32d4688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ad4c8abb3447bd8ad5f5f2e95e2d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-49bd0997-9686-4082-924c-1e5f40804f33 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 200 len: 1572 microversion: 2.1 time: 0.280764 Apr 12 12:36:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 162/479] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:37 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 1572 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-unplugged", "status": "completed", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] Creating event network-vif-unplugged:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:36:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-eae887a9-36f4-4416-8b86-6c3382065f78 req-71453eae-1fb3-498f-ba3c-20c01368b551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031885 Apr 12 12:36:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 162/480] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:39 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:36:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e0c60ee2-353b-4bb2-b670-73f6a7cae773 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 204 len: 0 microversion: 2.1 time: 0.136433 Apr 12 12:36:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 157/481] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:36:39 2023] DELETE /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-aafe5729-06db-470a-a362-e8c7e234cf69 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 200 len: 1396 microversion: 2.1 time: 0.227436 Apr 12 12:36:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 163/482] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:39 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 1396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}, {"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}, {"server_uuid": "d584edf2-12e3-48d1-947f-fdfb0c9c7377", "name": "network-vif-deleted", "tag": "5fbb21e1-ece8-4e20-baa6-55fe59a41325"}, {"server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "name": "network-vif-unplugged", "status": "completed", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Creating event network-vif-plugged:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:36:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Creating event network-vif-plugged:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:36:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Creating event network-vif-deleted:5fbb21e1-ece8-4e20-baa6-55fe59a41325 for instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 on user Apr 12 12:36:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] Creating event network-vif-unplugged:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:36:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-ab0810d9-09ce-4607-84b7-7288ced2c903 req-f5eab61b-445f-4484-96ca-c20401e22d48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.068806 Apr 12 12:36:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 163/483] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "name": "network-vif-plugged", "status": "completed", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}, {"server_uuid": "cda12475-d730-4c07-af54-a3a64482fc94", "name": "network-vif-deleted", "tag": "00018f63-5e54-484b-beb9-e2aa082e0e5c"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Creating event network-vif-plugged:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:36:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] Creating event network-vif-deleted:00018f63-5e54-484b-beb9-e2aa082e0e5c for instance cda12475-d730-4c07-af54-a3a64482fc94 on user Apr 12 12:36:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3a0f1eb8-d0e2-4f27-b521-5a71a6b25251 req-dcc15e9e-87e1-4ce8-87c9-5eff69e8aaf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043417 Apr 12 12:36:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 158/484] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-586680af-a5c0-4573-8b83-e89af8173bd9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: .version_select at 0x7fc95d37b5b0>, body: {"keypair": {"name": "tempest-keypair-856573039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoCyqzs+8zrj4h6uGdmSsuDYdl4XZy4hARXsIlRPh7dRZ2tEg+K3UMhHPOf8n5+xfHG0dd1ftUcbN4N2gdcb3nvuvPgtvGBh8vkaOa3CldqRPPAwwxfvBWjOglZdUPChQ=="}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:44 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-586680af-a5c0-4573-8b83-e89af8173bd9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:36:44 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-586680af-a5c0-4573-8b83-e89af8173bd9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for user 1db0203a6e6f4cc3bccbf19577a0c82f and project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:36:44 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-586680af-a5c0-4573-8b83-e89af8173bd9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050964 Apr 12 12:36:44 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 164/485] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:36:44 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426605846", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507"}], "security_groups": [{"name": "tempest-securitygroup--689860396"}], "key_name": "tempest-keypair-856573039", "user_data": "}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:36:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-7415841b-754d-43d9-938f-ee54939fde55 req-fb22ec50-7033-4501-987e-342840c0209c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052039 Apr 12 12:36:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 164/486] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] validate_networks() for [('0fcfa7dc-806e-48a8-aa1d-a7a72dd6f507', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:47 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:36:47 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Getting quotas for user 1db0203a6e6f4cc3bccbf19577a0c82f and project f9ec9671123c4a00a2880de4b4df8d3e. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:36:47 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:36:47 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:36:47 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2854e2dc-511f-445d-8a6b-df2c30bc2821 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888904 Apr 12 12:36:47 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 159/487] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:36:46 2023] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 12:36:47 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a3cc82f8-90d4-436a-b389-b96c15d61b0c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:47 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a3cc82f8-90d4-436a-b389-b96c15d61b0c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:47 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-a3cc82f8-90d4-436a-b389-b96c15d61b0c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a3cc82f8-90d4-436a-b389-b96c15d61b0c tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1239 microversion: 2.1 time: 0.113212 Apr 12 12:36:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:47 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1239 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:36:48 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-515ddde5-64ff-483d-98b0-894ac61ba3a0 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 204 len: 0 microversion: 2.1 time: 0.126548 Apr 12 12:36:48 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 165/489] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:36:48 2023] DELETE /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:36:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-2c811ced-8c5f-459d-8353-fc5ae1389e91 req-cb0d431b-c984-48db-a77c-ab6dc0396887 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038141 Apr 12 12:36:48 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 166/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "name": "network-vif-unplugged", "status": "completed", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:48 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:48 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] Creating event network-vif-unplugged:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:36:48 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-fe40c372-65ae-49db-8acc-3be0772e5973 req-2d05324c-4ded-40f6-9a23-b2e1cb032453 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031382 Apr 12 12:36:48 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 166/491] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:48 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-efb62957-b586-4a8d-9377-263cabb097db tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 200 len: 1499 microversion: 2.1 time: 0.517470 Apr 12 12:36:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 160/492] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:48 2023] GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 1499 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:50 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1183d494-7473-4c73-ae15-34b5f0e8fba0 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1433 microversion: 2.1 time: 0.171706 Apr 12 12:36:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 167/493] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:50 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1433 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "name": "network-vif-plugged", "status": "completed", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] Creating event network-vif-plugged:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:36:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-659aa3e8-33ad-405d-80d0-16ebf4fc9ba7 req-03859aa1-54be-4783-901f-9510a72bf673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052512 Apr 12 12:36:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 167/494] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe72c043-e035-4926-8f7f-455285f0dbe8", "name": "network-vif-deleted", "tag": "2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] Creating event network-vif-deleted:2a5696a6-8fb5-4cb0-ba0f-12ef794fc9fd for instance fe72c043-e035-4926-8f7f-455285f0dbe8 on user Apr 12 12:36:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-2edbea04-88a0-4625-a3d4-e662d3d3985c req-c8e84903-b5da-49ad-bffd-8c9c82d2d963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036388 Apr 12 12:36:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 161/495] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] Creating event network-changed:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:36:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-98691480-49a9-4ece-980d-04dd51d73a5d req-f4b746b1-4bcc-4a72-9596-01ee483f376a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Apr 12 12:36:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 168/496] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:52 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:36:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] Creating event network-changed:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:36:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-28f0a6bf-e67c-4de1-831c-36f6d9a6f4c3 req-c9e49dda-a67f-41d7-a6ba-868f11d2e197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060272 Apr 12 12:36:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 168/497] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:52 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lazy-loading 'flavor' on Instance uuid fa011231-049f-40c3-89c0-53447a35752f {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:36:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-00673f05-5c40-4986-8c92-607d78412c4b tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f/action" status: 202 len: 0 microversion: 2.1 time: 0.123204 Apr 12 12:36:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 162/498] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:36:52 2023] POST /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:53 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:36:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7426d998-4e0c-46a8-9ca9-b0111d03d258 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1439 microversion: 2.1 time: 0.233093 Apr 12 12:36:53 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 169/499] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:36:52 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1439 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:36:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:36:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:36:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-11766f80-321b-4756-aa23-206078ed6090 req-d9b6d6b8-6f37-495e-adb8-1f63b2bc55b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034955 Apr 12 12:36:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 169/500] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-unplugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}, {"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Creating event network-vif-unplugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:36:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:36:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-084d9944-5b96-4669-82a7-3852ae7f735a req-aa0e5e44-0dfc-434d-bc71-84a7102db804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047657 Apr 12 12:36:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 163/501] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:36:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:36:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:36:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:36:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:36:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] Creating event network-changed:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:36:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-ae880407-7806-498b-bee1-67470828b139 req-e2f182f7-6624-4861-8ccc-aceca5936a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032900 Apr 12 12:36:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 170/502] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "25291897-9c4e-4932-9e54-5ac0c5794d9d"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] HTTP exception thrown: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Request method failure captured: Apr 12 12:37:04 user devstack@n-api.service[61615]: request: PUT /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad/os-volume_attachments/7b045e1c-42e9-49fa-89b3-6afe5e39eb96 HTTP/1.1 Apr 12 12:37:04 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:37:04 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:37:04 user devstack@n-api.service[61615]: Connection: close Apr 12 12:37:04 user devstack@n-api.service[61615]: Content-Length: 74 Apr 12 12:37:04 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:37:04 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:37:04 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:37:04 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqTOFU3CZ3bcSjVPn8LOooJvn5LydNDqjrqDP8xVoW65Hfy7hYda7C6DU5OzNMhkQX13tn-EmGwGWcJ5R-9dUUpSLSLnK4XuMAFi9udWsNJIRL5z8i94lUYX1brmrFs8aikjvKs3qDmE-V1qPa0dW_46b5yLtTwLklzQdz40CljSvHk Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Project-Id: cf1701d3b23647e5bab90d28ee98ac14 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Role: admin,member,reader Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Roles: admin,member,reader Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf1701d3b23647e5bab90d28ee98ac14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Tenant-Id: cf1701d3b23647e5bab90d28ee98ac14 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-693588654 Apr 12 12:37:04 user devstack@n-api.service[61615]: X-User: tempest-VolumesAdminNegativeTest-693588654-project-admin Apr 12 12:37:04 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:37:04 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:37:04 user devstack@n-api.service[61615]: X-User-Id: d37c1dfdfcda424b823bd52790f92eca Apr 12 12:37:04 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesAdminNegativeTest-693588654-project-admin Apr 12 12:37:04 user devstack@n-api.service[61615]: Apr 12 12:37:04 user devstack@n-api.service[61615]: {"volumeAttachment": {"volumeId": "25291897-9c4e-4932-9e54-5ac0c5794d9d"}} Apr 12 12:37:04 user devstack@n-api.service[61615]: method: > Apr 12 12:37:04 user devstack@n-api.service[61615]: exception: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. Apr 12 12:37:04 user devstack@n-api.service[61615]: action_args: {'server_id': 'c24566ee-48cd-4cc4-aaea-28b1eae34fad', 'id': '7b045e1c-42e9-49fa-89b3-6afe5e39eb96', 'body': {'volumeAttachment': {'volumeId': '25291897-9c4e-4932-9e54-5ac0c5794d9d'}}} Apr 12 12:37:04 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. (HTTP 404) (Request-ID: req-84581152-78ff-44e7-bc64-e488d6e534fe) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. Apr 12 12:37:04 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] Returning 404 to user: Volume 7b045e1c-42e9-49fa-89b3-6afe5e39eb96 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4465b8d0-2565-4880-bdd0-5aca2405c777 tempest-VolumesAdminNegativeTest-693588654 tempest-VolumesAdminNegativeTest-693588654-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad/os-volume_attachments/7b045e1c-42e9-49fa-89b3-6afe5e39eb96" status: 404 len: 109 microversion: 2.1 time: 0.134204 Apr 12 12:37:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 170/503] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 12:37:04 2023] PUT /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad/os-volume_attachments/7b045e1c-42e9-49fa-89b3-6afe5e39eb96 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:37:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4672d577-a1ac-4287-b158-13d9c4b0c9b3 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad" status: 204 len: 0 microversion: 2.1 time: 0.212444 Apr 12 12:37:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 164/504] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:37:07 2023] DELETE /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=40 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:07 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c5a179ad-40dd-4231-a1aa-c9b58ba97925 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad" status: 200 len: 1500 microversion: 2.1 time: 0.220438 Apr 12 12:37:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 171/505] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:07 2023] GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad => generated 1500 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "name": "network-vif-unplugged", "status": "completed", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] Creating event network-vif-unplugged:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:37:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f717736a-5032-4e54-88f9-523599b17021 req-a912d26f-702d-425d-8fcd-acd68ba70695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161200 Apr 12 12:37:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 171/506] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-39239193-4f11-4eb2-a6c1-80de7ac98dd7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1678 microversion: 2.1 time: 0.370961 Apr 12 12:37:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 165/507] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:08 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1678 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "285a2e71-c724-427a-94a8-d0f646e9083f"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-013e80e3-5ff1-4030-9bb6-2e682ee14152 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358221 Apr 12 12:37:09 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 172/508] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:37:08 2023] POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "name": "network-vif-deleted", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] Creating event network-vif-deleted:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:37:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-8bebca0c-3be0-4b3d-9604-0bf0cebf4c79 req-d28d0b9b-5de0-4d80-87fc-d152aee9ad85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Apr 12 12:37:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 172/509] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24566ee-48cd-4cc4-aaea-28b1eae34fad", "name": "network-vif-plugged", "status": "completed", "tag": "1df30b7e-ae74-466e-8076-8ba92f855cc8"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] Creating event network-vif-plugged:1df30b7e-ae74-466e-8076-8ba92f855cc8 for instance c24566ee-48cd-4cc4-aaea-28b1eae34fad on user Apr 12 12:37:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-089d45ec-6cbb-48aa-a1ff-a9b45f25e037 req-ecc35721-d2fc-45d9-a421-f82b279cc22e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Apr 12 12:37:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 166/510] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Old instance type m1.nano, new instance type m1.micro {{(pid=61614) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:16 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'ram', 'cores'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'ram', 'cores'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:37:17 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:37:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ce24fd76-d649-4dab-98ea-bf5bae56fc75 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action" status: 202 len: 0 microversion: 2.1 time: 0.313894 Apr 12 12:37:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 173/511] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:37:16 2023] POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:17 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2c183013-1592-4055-8fbd-26f1d2f1c713 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1733 microversion: 2.1 time: 0.185152 Apr 12 12:37:17 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 173/512] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:17 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:19 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:19 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:19 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-0e990527-7efa-4c33-b260-e5be6be13c68 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1782 microversion: 2.20 time: 0.159925 Apr 12 12:37:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 167/513] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:37:18 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1782 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:37:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-unplugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Creating event network-vif-unplugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:37:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:37:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-295852f0-e867-4562-9916-fb05bd34c8e4 req-d2ed9d56-f722-41cb-b4ca-c6dbfc269162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056161 Apr 12 12:37:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 174/514] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:23 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:37:23 user devstack@n-api.service[61615]: DEBUG nova.compute.api [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:37:23 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-2ef9b723-bd27-4dae-ad5a-28f3b236253d req-32b90b8f-552a-4a48-b636-357983bcd782 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045664 Apr 12 12:37:23 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 174/515] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] [instance: d584edf2-12e3-48d1-947f-fdfb0c9c7377] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] HTTP exception thrown: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Request method failure captured: Apr 12 12:37:28 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 HTTP/1.1 Apr 12 12:37:28 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:37:28 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:37:28 user devstack@n-api.service[61616]: Connection: close Apr 12 12:37:28 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:37:28 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:37:28 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:37:28 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:37:28 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqRGdQ69A5kfVuL1SAmJSRT80KyfsykOn-iJtYdxwghUPHRZN0Zum9PL8SEvbHnWSmcVF9dV_zUdM48upGuEzLW-7ZxMjvLcLC3OMu7-6Zw77EdI4bqkZDux9ELtq0srvzB3fF1E2Ovfw4DxWqaiUET4r_b9pi0F-gBjGWEwXG2kdPc Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Project-Id: c8ad4c8abb3447bd8ad5f5f2e95e2d78 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1611683463 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c8ad4c8abb3447bd8ad5f5f2e95e2d78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c8ad4c8abb3447bd8ad5f5f2e95e2d78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c8ad4c8abb3447bd8ad5f5f2e95e2d78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Tenant: tempest-SnapshotDataIntegrityTests-1611683463 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Tenant-Id: c8ad4c8abb3447bd8ad5f5f2e95e2d78 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1611683463 Apr 12 12:37:28 user devstack@n-api.service[61616]: X-User: tempest-SnapshotDataIntegrityTests-1611683463-project-member Apr 12 12:37:28 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:37:28 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:37:28 user devstack@n-api.service[61616]: X-User-Id: 2272654f6bbb4fb39b3c334c32d4688c Apr 12 12:37:28 user devstack@n-api.service[61616]: X-User-Name: tempest-SnapshotDataIntegrityTests-1611683463-project-member Apr 12 12:37:28 user devstack@n-api.service[61616]: method: > Apr 12 12:37:28 user devstack@n-api.service[61616]: exception: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. Apr 12 12:37:28 user devstack@n-api.service[61616]: action_args: {'id': 'd584edf2-12e3-48d1-947f-fdfb0c9c7377'} Apr 12 12:37:28 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. Apr 12 12:37:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Returning 404 to user: Instance d584edf2-12e3-48d1-947f-fdfb0c9c7377 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-bc41315b-08c4-408b-b539-4d7cc20ee676 tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377" status: 404 len: 111 microversion: 2.1 time: 0.034565 Apr 12 12:37:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 168/516] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:28 2023] GET /compute/v2.1/servers/d584edf2-12e3-48d1-947f-fdfb0c9c7377 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e6124bd0-8bc7-44fe-9fd4-4ce8d34de72d tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] Calling method '.version_select at 0x7fc95d135750>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e6124bd0-8bc7-44fe-9fd4-4ce8d34de72d tempest-SnapshotDataIntegrityTests-1611683463 tempest-SnapshotDataIntegrityTests-1611683463-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1869203116" status: 202 len: 0 microversion: 2.1 time: 0.032615 Apr 12 12:37:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 175/517] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 12 12:37:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1869203116 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=14 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=22 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:37:30 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 HTTP/1.1 Apr 12 12:37:30 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:37:30 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:37:30 user devstack@n-api.service[61615]: Connection: close Apr 12 12:37:30 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:37:30 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:37:30 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:37:30 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:37:30 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61615]: method: > Apr 12 12:37:30 user devstack@n-api.service[61615]: exception: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: action_args: {'id': 'cda12475-d730-4c07-af54-a3a64482fc94'} Apr 12 12:37:30 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-aed44305-6ef4-48d0-8596-0ad4bea39668 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 404 len: 111 microversion: 2.1 time: 0.042346 Apr 12 12:37:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 175/518] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:30 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:37:30 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 HTTP/1.1 Apr 12 12:37:30 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:37:30 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:37:30 user devstack@n-api.service[61616]: Connection: close Apr 12 12:37:30 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:37:30 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:37:30 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:37:30 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:37:30 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61616]: method: > Apr 12 12:37:30 user devstack@n-api.service[61616]: exception: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: action_args: {'id': '239b22bb-d381-4bd3-9b73-642f174d7664'} Apr 12 12:37:30 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b7fec047-3e2d-487c-b26d-b4bf1cdcaaf4 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 404 len: 111 microversion: 2.1 time: 0.045509 Apr 12 12:37:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 169/519] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:37:30 2023] DELETE /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 239b22bb-d381-4bd3-9b73-642f174d7664] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:37:30 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 HTTP/1.1 Apr 12 12:37:30 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:37:30 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:37:30 user devstack@n-api.service[61614]: Connection: close Apr 12 12:37:30 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:37:30 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:37:30 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:37:30 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:37:30 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61614]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:37:30 user devstack@n-api.service[61614]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61614]: method: > Apr 12 12:37:30 user devstack@n-api.service[61614]: exception: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61614]: action_args: {'id': '239b22bb-d381-4bd3-9b73-642f174d7664'} Apr 12 12:37:30 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 239b22bb-d381-4bd3-9b73-642f174d7664 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-06e63b85-1a05-4cdc-a558-ac354b893b0d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664" status: 404 len: 111 microversion: 2.1 time: 0.031369 Apr 12 12:37:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 176/520] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:30 2023] GET /compute/v2.1/servers/239b22bb-d381-4bd3-9b73-642f174d7664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:37:30 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 HTTP/1.1 Apr 12 12:37:30 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:37:30 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:37:30 user devstack@n-api.service[61615]: Connection: close Apr 12 12:37:30 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:37:30 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:37:30 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:37:30 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:37:30 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:37:30 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61615]: method: > Apr 12 12:37:30 user devstack@n-api.service[61615]: exception: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: action_args: {'id': 'cda12475-d730-4c07-af54-a3a64482fc94'} Apr 12 12:37:30 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-281202df-d7d1-4926-8659-1149973f8808 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 404 len: 111 microversion: 2.1 time: 0.035184 Apr 12 12:37:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 176/521] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:37:30 2023] DELETE /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: cda12475-d730-4c07-af54-a3a64482fc94] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:37:30 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 HTTP/1.1 Apr 12 12:37:30 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:37:30 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:37:30 user devstack@n-api.service[61616]: Connection: close Apr 12 12:37:30 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:37:30 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:37:30 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:37:30 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:37:30 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:37:30 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:37:30 user devstack@n-api.service[61616]: method: > Apr 12 12:37:30 user devstack@n-api.service[61616]: exception: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: action_args: {'id': 'cda12475-d730-4c07-af54-a3a64482fc94'} Apr 12 12:37:30 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. Apr 12 12:37:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:37:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance cda12475-d730-4c07-af54-a3a64482fc94 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-78a37574-dc86-49e7-bd50-8b7ee7f28cbb tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94" status: 404 len: 111 microversion: 2.1 time: 0.040295 Apr 12 12:37:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 170/522] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:30 2023] GET /compute/v2.1/servers/cda12475-d730-4c07-af54-a3a64482fc94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d9fcaf51-0eba-45d0-8367-7343843e439e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: .version_select at 0x7fc95d134790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1044387718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsgnjp9DU7mhDKOnejfarx74lKPsdA7XFVVac0IXQsHunQgmiZdnkpBnb9o+2GfDpfLr3Vtu/GonERs5AS6wpKwmtd3eb4XJchkGev4GCvYiSWT7o/Zl3+nrrnYoAMm1w=="}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-d9fcaf51-0eba-45d0-8367-7343843e439e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:37:30 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-d9fcaf51-0eba-45d0-8367-7343843e439e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'key_pairs'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:37:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d9fcaf51-0eba-45d0-8367-7343843e439e tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.083549 Apr 12 12:37:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 177/523] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:37:30 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:32 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:37:32 user devstack@n-api.service[61615]: DEBUG nova.compute.api [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:37:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-cc23f6d5-da24-4faf-8fd0-5ad8e973e148 req-353b529c-ea03-42d0-aac6-86494303052f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048630 Apr 12 12:37:32 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 177/524] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:37:34 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:37:34 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:37:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-25b271a2-1c8e-4ec4-9c82-92482796280a req-d5921965-b1ee-4ae4-83cd-59e7b91b746f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051253 Apr 12 12:37:34 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 171/525] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1229089641", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1044387718", "security_groups": [{"name": "tempest-secgroup-smoke-200001683"}], "block_device_mapping_v2": [{"uuid": "b02750fc-665e-4715-9399-bb359cf6b1a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:37:35 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:37:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:37:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b02750fc-665e-4715-9399-bb359cf6b1a5',volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:37:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c2b77d48-d4b7-493a-8d1b-1ef85998123d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.957191 Apr 12 12:37:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 178/526] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:37:35 2023] POST /compute/v2.1/servers => generated 403 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:37:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-efefedca-b55f-42b0-819d-f0c62243ee32 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:36 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-efefedca-b55f-42b0-819d-f0c62243ee32 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:36 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-efefedca-b55f-42b0-819d-f0c62243ee32 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-efefedca-b55f-42b0-819d-f0c62243ee32 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 200 len: 1090 microversion: 2.1 time: 0.085930 Apr 12 12:37:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 178/527] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:36 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 1090 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:37 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9a3df3b4-e043-4106-a206-3678d7c0d977 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1552 microversion: 2.1 time: 0.185415 Apr 12 12:37:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 172/528] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:37 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1552 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] HTTP exception thrown: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:37:38 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 HTTP/1.1 Apr 12 12:37:38 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:37:38 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:37:38 user devstack@n-api.service[61614]: Connection: close Apr 12 12:37:38 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:37:38 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:37:38 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:37:38 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:37:38 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:37:38 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:37:38 user devstack@n-api.service[61614]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:37:38 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:37:38 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:37:38 user devstack@n-api.service[61614]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:37:38 user devstack@n-api.service[61614]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:37:38 user devstack@n-api.service[61614]: method: > Apr 12 12:37:38 user devstack@n-api.service[61614]: exception: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:37:38 user devstack@n-api.service[61614]: action_args: {'id': 'fe72c043-e035-4926-8f7f-455285f0dbe8'} Apr 12 12:37:38 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:37:38 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 404 to user: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6d7a0e63-a0fc-4551-abc6-bce3ca2c5ec5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 404 len: 111 microversion: 2.1 time: 0.048906 Apr 12 12:37:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 179/529] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:38 2023] GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:39 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-41bf64af-992c-476b-8489-76dc38aec1cd tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1491 microversion: 2.1 time: 0.192341 Apr 12 12:37:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 179/530] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:38 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1491 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:39 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] Creating event network-changed:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:37:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-5117ffee-9c9f-4db2-82a6-2f9c9ff11145 req-7eb4e016-7fb6-4984-ab1d-9ef5c4852b10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041288 Apr 12 12:37:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 173/531] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:37:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e73bac29-dfc2-4a10-9591-c30e5e987eb3 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1499 microversion: 2.1 time: 0.168831 Apr 12 12:37:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 180/532] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:43 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:37:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "name": "network-vif-plugged", "status": "completed", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:46 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] Creating event network-vif-plugged:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:37:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-091b1f02-f4f8-4d07-8743-65eb3e76a683 req-40cbb971-5eb0-4a4d-8abc-4b9b9b4d0ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Apr 12 12:37:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 180/533] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "name": "network-vif-plugged", "status": "completed", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:37:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] Creating event network-vif-plugged:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:37:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-cef61e6f-b064-4ec5-894a-510633a181bf req-33f6a73d-3f1b-410b-9262-5adea70ab0aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 Apr 12 12:37:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 174/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:37:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=7 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c24566ee-48cd-4cc4-aaea-28b1eae34fad] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:37:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] HTTP exception thrown: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Request method failure captured: Apr 12 12:37:58 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad HTTP/1.1 Apr 12 12:37:58 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:37:58 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:37:58 user devstack@n-api.service[61614]: Connection: close Apr 12 12:37:58 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:37:58 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:37:58 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:37:58 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:37:58 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqTG458VNeL1PcuRS0iLcaOBuKKACaEnpao6gdkYE6ioPkF7jvBch5Kk4t-ClLvQqi2nXMGJFlUqOSPbF_V9PczrQgYz44qRIwvAmDhfWsqlNrFWE6m-KU_c88W6vegLjaQ2_6B1lC80mOu7AqTYo6bjMWtYpbO4qzw-uyYAy602N5g Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Project-Id: 7d607e0aed1f47129540181261c6ebc7 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Tenant-Id: 7d607e0aed1f47129540181261c6ebc7 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-User: tempest-VolumesAdminNegativeTest-714206228-project-member Apr 12 12:37:58 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:37:58 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:37:58 user devstack@n-api.service[61614]: X-User-Id: b3a887c10bf74974a648e3ec048fcdd7 Apr 12 12:37:58 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesAdminNegativeTest-714206228-project-member Apr 12 12:37:58 user devstack@n-api.service[61614]: method: > Apr 12 12:37:58 user devstack@n-api.service[61614]: exception: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. Apr 12 12:37:58 user devstack@n-api.service[61614]: action_args: {'id': 'c24566ee-48cd-4cc4-aaea-28b1eae34fad'} Apr 12 12:37:58 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. Apr 12 12:37:58 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:37:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Returning 404 to user: Instance c24566ee-48cd-4cc4-aaea-28b1eae34fad could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:37:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-dea42ecd-80d2-4dc7-aaac-970f92df2a82 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad" status: 404 len: 111 microversion: 2.1 time: 0.243865 Apr 12 12:37:58 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 181/535] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:37:57 2023] GET /compute/v2.1/servers/c24566ee-48cd-4cc4-aaea-28b1eae34fad => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=13 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=15 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:00 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:38:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d6dcc941-d6af-4660-940e-c8d1dd16a4cf tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29" status: 204 len: 0 microversion: 2.1 time: 0.138305 Apr 12 12:38:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 181/536] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:38:00 2023] DELETE /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=5 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:01 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a887c10bf74974a648e3ec048fcdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d607e0aed1f47129540181261c6ebc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e1a30c1c-8d37-44c5-8cc6-a7f6080f4ab5 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29" status: 200 len: 1667 microversion: 2.1 time: 0.590086 Apr 12 12:38:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 175/537] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:00 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => generated 1667 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "name": "network-vif-unplugged", "status": "completed", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] Creating event network-vif-unplugged:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:38:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9c9ba4e2-2f47-486a-95c0-58ac9bba8ab7 req-b1bd39d1-0021-4d49-9e96-0a23bf66dc94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035886 Apr 12 12:38:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 182/538] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "name": "network-vif-plugged", "status": "completed", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}, {"server_uuid": "c5b9b1bb-a3d9-4073-8d49-70360dae6f29", "name": "network-vif-deleted", "tag": "33441356-cd95-4247-86bb-3f49f00d8e81"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Creating event network-vif-plugged:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:38:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] Creating event network-vif-deleted:33441356-cd95-4247-86bb-3f49f00d8e81 for instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 on user Apr 12 12:38:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-dbb0a7fb-e53c-4f75-a05c-206409474091 req-7005e032-9800-4887-b5bb-f1c26edda3a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029260 Apr 12 12:38:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 182/539] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:07 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-6a809625-938a-4c35-99f8-e41eea6299e7 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1732 microversion: 2.1 time: 0.152552 Apr 12 12:38:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 176/540] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:07 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fd281f5a-ed56-4865-8b16-c34fc4857e92 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments/b9c08f12-a467-4152-a8fb-00aef87ac9c9" status: 200 len: 194 microversion: 2.20 time: 0.263450 Apr 12 12:38:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 183/541] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 12:38:19 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments/b9c08f12-a467-4152-a8fb-00aef87ac9c9 => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:19 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'services' on Instance uuid 9439468d-7a45-443b-87ce-106907761a56 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:38:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c939223f-8083-41e5-91d5-b3a3911bcf7c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments/b9c08f12-a467-4152-a8fb-00aef87ac9c9" status: 202 len: 0 microversion: 2.20 time: 0.277613 Apr 12 12:38:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 183/542] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 12:38:19 2023] DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments/b9c08f12-a467-4152-a8fb-00aef87ac9c9 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-09cbc46c-5d9d-4b4e-ab50-b33df306af38 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068460 Apr 12 12:38:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 177/543] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 12:38:19 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:26 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5ccd1ee7-8586-4b8a-a65b-b63db9ab76ff tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 200 len: 1441 microversion: 2.1 time: 0.353611 Apr 12 12:38:26 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 184/544] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:26 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 1441 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4c2e2d30-cb09-4585-8436-f8d3b495f8b9 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.093620 Apr 12 12:38:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 184/545] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:38:37 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-interface => generated 282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] Creating event network-changed:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:38:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-edd23fa6-633a-4537-a3f6-0069026b791d req-85f0af68-6ac6-430f-90d8-624e8ddd7798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040841 Apr 12 12:38:38 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 178/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2695aae0-2bb7-41a8-9f06-dd2df4aba06b"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ca150a25-3273-49c2-b7fe-e342700b4165 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293812 Apr 12 12:38:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 185/547] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:38:38 2023] POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0e10e21c-20c0-458e-a62e-11b5794e7f91 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243413180", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c38b8ee0-7897-41a9-b1e1-174740156de5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-0e10e21c-20c0-458e-a62e-11b5794e7f91 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] HTTP exception thrown: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. Apr 12 12:38:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0e10e21c-20c0-458e-a62e-11b5794e7f91 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:38:41 user devstack@n-api.service[61615]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 12:38:41 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:38:41 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:38:41 user devstack@n-api.service[61615]: Connection: close Apr 12 12:38:41 user devstack@n-api.service[61615]: Content-Length: 357 Apr 12 12:38:41 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:38:41 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:38:41 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:38:41 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:38:41 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:38:41 user devstack@n-api.service[61615]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:38:41 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:38:41 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:38:41 user devstack@n-api.service[61615]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:38:41 user devstack@n-api.service[61615]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:38:41 user devstack@n-api.service[61615]: Apr 12 12:38:41 user devstack@n-api.service[61615]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243413180", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c38b8ee0-7897-41a9-b1e1-174740156de5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} Apr 12 12:38:41 user devstack@n-api.service[61615]: method: > Apr 12 12:38:41 user devstack@n-api.service[61615]: exception: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. Apr 12 12:38:41 user devstack@n-api.service[61615]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1243413180', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c38b8ee0-7897-41a9-b1e1-174740156de5'}], 'networks': [{'uuid': '963759e8-808d-494c-9dea-0efa9f78804a'}]}}} Apr 12 12:38:41 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. Apr 12 12:38:41 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0e10e21c-20c0-458e-a62e-11b5794e7f91 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 400 to user: Block Device c38b8ee0-7897-41a9-b1e1-174740156de5 is not bootable. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:38:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0e10e21c-20c0-458e-a62e-11b5794e7f91 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.069549 Apr 12 12:38:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 185/548] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:38:41 2023] POST /compute/v2.1/servers => generated 110 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:41 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c69fcd66-6691-4871-afd7-4644b7b2cc67 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1491 microversion: 2.1 time: 0.227976 Apr 12 12:38:41 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 179/549] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:41 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1491 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61614) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 12:38:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-875d5303-c467-4696-a124-aff0c41fa39e tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f/action" status: 202 len: 0 microversion: 2.1 time: 0.143164 Apr 12 12:38:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 186/550] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:38:43 2023] POST /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9bf334a5-c5b3-429f-9341-dbefa3d3d53f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1507 microversion: 2.1 time: 0.180728 Apr 12 12:38:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 186/551] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:43 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:46 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'flavor' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:38:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b5307b8f-0825-4ac7-bc96-9602a37c505f tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/action" status: 200 len: 32 microversion: 2.1 time: 0.167279 Apr 12 12:38:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 180/552] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:38:46 2023] POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:46 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:38:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2e8481ec-ff1f-4933-b353-3a364322fc4b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1722 microversion: 2.1 time: 0.167100 Apr 12 12:38:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 187/553] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:46 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:38:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-unplugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] Creating event network-vif-unplugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:38:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0f51ff9b-45ae-4430-9ef7-402e334aa9d1 req-a1915606-721d-49d3-bc1b-699ece3bc2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036818 Apr 12 12:38:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 187/554] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:38:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e2c7347a-8511-4773-b719-84387d105b18 req-ab5ed423-111b-4e0c-9ddf-9232a97fd663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029618 Apr 12 12:38:49 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 181/555] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] Creating event network-changed:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:38:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-01a0e2e3-e95a-4b14-bf61-9cbeb24a017d req-d4a7aacc-bd68-4a44-9a6d-93d4c3b95685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085817 Apr 12 12:38:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 188/556] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] [instance: c5b9b1bb-a3d9-4073-8d49-70360dae6f29] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] HTTP exception thrown: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Request method failure captured: Apr 12 12:38:51 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 HTTP/1.1 Apr 12 12:38:51 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:38:51 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:38:51 user devstack@n-api.service[61615]: Connection: close Apr 12 12:38:51 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:38:51 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:38:51 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:38:51 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:38:51 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqTG458VNeL1PcuRS0iLcaOBuKKACaEnpao6gdkYE6ioPkF7jvBch5Kk4t-ClLvQqi2nXMGJFlUqOSPbF_V9PczrQgYz44qRIwvAmDhfWsqlNrFWE6m-KU_c88W6vegLjaQ2_6B1lC80mOu7AqTYo6bjMWtYpbO4qzw-uyYAy602N5g Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Project-Id: 7d607e0aed1f47129540181261c6ebc7 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d607e0aed1f47129540181261c6ebc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Tenant-Id: 7d607e0aed1f47129540181261c6ebc7 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-714206228 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-User: tempest-VolumesAdminNegativeTest-714206228-project-member Apr 12 12:38:51 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:38:51 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:38:51 user devstack@n-api.service[61615]: X-User-Id: b3a887c10bf74974a648e3ec048fcdd7 Apr 12 12:38:51 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesAdminNegativeTest-714206228-project-member Apr 12 12:38:51 user devstack@n-api.service[61615]: method: > Apr 12 12:38:51 user devstack@n-api.service[61615]: exception: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. Apr 12 12:38:51 user devstack@n-api.service[61615]: action_args: {'id': 'c5b9b1bb-a3d9-4073-8d49-70360dae6f29'} Apr 12 12:38:51 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. Apr 12 12:38:51 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:38:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Returning 404 to user: Instance c5b9b1bb-a3d9-4073-8d49-70360dae6f29 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:38:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-db4ebafd-526a-40ca-9909-1e2d745d3607 tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29" status: 404 len: 111 microversion: 2.1 time: 0.029440 Apr 12 12:38:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 188/557] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:38:51 2023] GET /compute/v2.1/servers/c5b9b1bb-a3d9-4073-8d49-70360dae6f29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:38:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-251d7e19-b22b-4933-a924-89d16fb6d3ad tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] Calling method '.version_select at 0x7fc95d26bf40>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:38:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-251d7e19-b22b-4933-a924-89d16fb6d3ad tempest-VolumesAdminNegativeTest-714206228 tempest-VolumesAdminNegativeTest-714206228-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323125528" status: 202 len: 0 microversion: 2.1 time: 0.026576 Apr 12 12:38:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 182/558] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 12:38:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323125528 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:38:51 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:38:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:38:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-065ff361-ba26-4b33-b71a-3b53ffda859f req-6a2dbcc4-bd02-4802-8769-aa2c10b5627a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033247 Apr 12 12:38:51 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 189/559] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:38:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-61460d17-0249-4cff-b708-7ef6f879af98 req-9cd456bb-f16d-46fd-9b64-82d329ceb6df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032449 Apr 12 12:38:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 189/560] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:38:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:38:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:38:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:38:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:38:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:38:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-b5b4aaa2-3e3e-4059-a40e-27a8e22e2dc9 req-94b78c0e-a053-4360-ac21-e5f68b0edb2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037005 Apr 12 12:38:56 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 183/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:38:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f4c4d63-c666-4f07-bd58-e76b1d7a3024 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Action: 'create', calling method: .version_select at 0x7fc95d1d57e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-845069103", "metadata": {"Type": "work"}}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f4c4d63-c666-4f07-bd58-e76b1d7a3024 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61614]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61614]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Length: 121 Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: Apr 12 12:39:00 user devstack@n-api.service[61614]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-845069103", "metadata": {"Type": "work"}}} Apr 12 12:39:00 user devstack@n-api.service[61614]: method: Apr 12 12:39:00 user devstack@n-api.service[61614]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61614]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-845069103', 'metadata': {'Type': 'work'}}}} Apr 12 12:39:00 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise error Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f4c4d63-c666-4f07-bd58-e76b1d7a3024 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4f4c4d63-c666-4f07-bd58-e76b1d7a3024 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.324409 Apr 12 12:39:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 190/562] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 12:39:00 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f5037836-5fba-4b81-9128-bc7d67c77804 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Action: 'create', calling method: .version_select at 0x7fc95d3b7b50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-788341574", "metadata": {"Type": "work"}}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f5037836-5fba-4b81-9128-bc7d67c77804 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61615]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61615]: Content-Length: 119 Apr 12 12:39:00 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61615]: Apr 12 12:39:00 user devstack@n-api.service[61615]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-788341574", "metadata": {"Type": "work"}}} Apr 12 12:39:00 user devstack@n-api.service[61615]: method: Apr 12 12:39:00 user devstack@n-api.service[61615]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 12:39:00 user devstack@n-api.service[61615]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-788341574', 'metadata': {'Type': 'work'}}}} Apr 12 12:39:00 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise error Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi '0' Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f5037836-5fba-4b81-9128-bc7d67c77804 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f5037836-5fba-4b81-9128-bc7d67c77804 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010049 Apr 12 12:39:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 190/563] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 12:39:00 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b11e129d-c817-46c0-a766-8d9681118269 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Action: 'create', calling method: .version_select at 0x7fc95d2f9000>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2054019491", "metadata": {"Type": "work"}}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b11e129d-c817-46c0-a766-8d9681118269 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61616]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61616]: Content-Length: 119 Apr 12 12:39:00 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61616]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61616]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61616]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61616]: Apr 12 12:39:00 user devstack@n-api.service[61616]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2054019491", "metadata": {"Type": "work"}}} Apr 12 12:39:00 user devstack@n-api.service[61616]: method: Apr 12 12:39:00 user devstack@n-api.service[61616]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61616]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2054019491', 'metadata': {'Type': 'work'}}}} Apr 12 12:39:00 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise error Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi '' Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 12:39:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b11e129d-c817-46c0-a766-8d9681118269 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b11e129d-c817-46c0-a766-8d9681118269 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012348 Apr 12 12:39:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 184/564] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 12:39:00 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b1ca6d10-7614-4281-add9-0364759535a4 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Calling method '.version_select at 0x7fc95d134280>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-b1ca6d10-7614-4281-add9-0364759535a4 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] HTTP exception thrown: Volume tempest-invalid-1937905832 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b1ca6d10-7614-4281-add9-0364759535a4 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1937905832 HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61614]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: method: Apr 12 12:39:00 user devstack@n-api.service[61614]: exception: Volume tempest-invalid-1937905832 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: action_args: {'id': 'tempest-invalid-1937905832'} Apr 12 12:39:00 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1937905832 could not be found. (HTTP 404) (Request-ID: req-523bd1c8-4a06-4887-8c98-64abf1059e6b) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1937905832 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1937905832 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1937905832 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b1ca6d10-7614-4281-add9-0364759535a4 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 404 to user: Volume tempest-invalid-1937905832 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b1ca6d10-7614-4281-add9-0364759535a4 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1937905832" status: 404 len: 99 microversion: 2.1 time: 0.037745 Apr 12 12:39:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 191/565] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 12:39:00 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1937905832 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-01d6a5b6-4e65-4125-81af-63f9658c4102 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003682 Apr 12 12:39:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 191/566] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 12:39:00 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-18bd8118-ba87-47b3-ae44-c0add9ddffe1 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004580 Apr 12 12:39:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 185/567] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 12:39:00 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3b372fc9-58d0-4ef8-9722-9edc60063338 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Calling method '.version_select at 0x7fc95d1d6320>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-3b372fc9-58d0-4ef8-9722-9edc60063338 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] HTTP exception thrown: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3b372fc9-58d0-4ef8-9722-9edc60063338 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/os-volumes/959fadc5-acb1-401c-a43b-52a61c66e64b HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61614]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:39:00 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61614]: method: Apr 12 12:39:00 user devstack@n-api.service[61614]: exception: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: action_args: {'id': '959fadc5-acb1-401c-a43b-52a61c66e64b'} Apr 12 12:39:00 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. (HTTP 404) (Request-ID: req-be1d74bf-7861-4c08-b468-39ee7a848190) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. Apr 12 12:39:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3b372fc9-58d0-4ef8-9722-9edc60063338 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 404 to user: Volume 959fadc5-acb1-401c-a43b-52a61c66e64b could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3b372fc9-58d0-4ef8-9722-9edc60063338 tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/959fadc5-acb1-401c-a43b-52a61c66e64b" status: 404 len: 109 microversion: 2.1 time: 0.035335 Apr 12 12:39:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 192/568] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:39:00 2023] DELETE /compute/v2.1/os-volumes/959fadc5-acb1-401c-a43b-52a61c66e64b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4aac6fad-35aa-4a5e-95c6-05c29e5aeb0f tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Calling method '.version_select at 0x7fc95d585120>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-4aac6fad-35aa-4a5e-95c6-05c29e5aeb0f tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] HTTP exception thrown: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4aac6fad-35aa-4a5e-95c6-05c29e5aeb0f tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Request method failure captured: Apr 12 12:39:00 user devstack@n-api.service[61615]: request: GET /compute/v2.1/os-volumes/e8c8cc0e-82b1-4310-81c6-8c0136e479f4 HTTP/1.1 Apr 12 12:39:00 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:39:00 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:39:00 user devstack@n-api.service[61615]: Connection: close Apr 12 12:39:00 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:39:00 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:39:00 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:39:00 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:39:00 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqZkf8Js9rUyRMOJcGxe7ERQ6KfVNvZNXzf8hGob6RBUY2gOkX1OdpJdGbMYtUOCcHXDGvxMRIzLa4aYYX3E6-VBjSXs2nT5m0I7vcoJDGvnoodq_r8o4_l5dUdqYOnO6WYnQmtr7C-ud_rurx3x50hdiVQvu4TwztX2E0BU1mih21k Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb86b9b610dd4000be47792c804c116c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant-Id: bb86b9b610dd4000be47792c804c116c Apr 12 12:39:00 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesNegativeTest-715333044 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Id: 4e5722a36570456ea1631499c9674471 Apr 12 12:39:00 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesNegativeTest-715333044-project-member Apr 12 12:39:00 user devstack@n-api.service[61615]: method: Apr 12 12:39:00 user devstack@n-api.service[61615]: exception: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61615]: action_args: {'id': 'e8c8cc0e-82b1-4310-81c6-8c0136e479f4'} Apr 12 12:39:00 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. (HTTP 404) (Request-ID: req-6b908c3c-9f4f-419a-a5e6-435bb705ad75) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. Apr 12 12:39:00 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:39:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4aac6fad-35aa-4a5e-95c6-05c29e5aeb0f tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] Returning 404 to user: Volume e8c8cc0e-82b1-4310-81c6-8c0136e479f4 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:39:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4aac6fad-35aa-4a5e-95c6-05c29e5aeb0f tempest-VolumesNegativeTest-715333044 tempest-VolumesNegativeTest-715333044-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e8c8cc0e-82b1-4310-81c6-8c0136e479f4" status: 404 len: 109 microversion: 2.1 time: 0.047675 Apr 12 12:39:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 192/569] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 12:39:00 2023] GET /compute/v2.1/os-volumes/e8c8cc0e-82b1-4310-81c6-8c0136e479f4 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-420882bf-e9e0-430d-8b2c-f49b94e54e22 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action" status: 202 len: 0 microversion: 2.1 time: 0.180645 Apr 12 12:39:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 186/570] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:39:07 2023] POST /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:08 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:08 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1da54691-0aea-4369-b760-5050fe05915e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1731 microversion: 2.1 time: 0.202709 Apr 12 12:39:08 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 193/571] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:07 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=16 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-unplugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Creating event network-vif-unplugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:39:08 user devstack@n-api.service[61615]: DEBUG nova.compute.api [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:39:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-e1a2c7e0-50fa-4e29-b492-67e34222219f req-44b1a82a-9715-4ae8-b22f-8a470046e1f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047051 Apr 12 12:39:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 193/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b544b849-bc57-4d58-883d-e269462ff267 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045078 Apr 12 12:39:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 187/573] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 12:39:10 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:39:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-67d0b5aa-5a86-46ac-85b0-410bc10176aa tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 204 len: 0 microversion: 2.20 time: 0.111755 Apr 12 12:39:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 194/574] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:39:10 2023] DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:10 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b9bc7d65-82bd-4393-880b-539e15497b3e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 200 len: 1710 microversion: 2.20 time: 0.209733 Apr 12 12:39:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 194/575] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:39:10 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 1710 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}, {"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-unplugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}, {"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-plugged", "status": "completed", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:39:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Creating event network-vif-unplugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:39:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Creating event network-vif-plugged:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:39:10 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:39:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-714a3eb7-263f-4495-a1f8-f9add6f06eeb req-daee5de1-a089-496d-839c-338e4a9a465e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.043316 Apr 12 12:39:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 188/576] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:12 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9439468d-7a45-443b-87ce-106907761a56", "name": "network-vif-deleted", "tag": "67b56c74-fc25-4bc8-875e-8a134830124b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] Creating event network-vif-deleted:67b56c74-fc25-4bc8-875e-8a134830124b for instance 9439468d-7a45-443b-87ce-106907761a56 on user Apr 12 12:39:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f19fe4f6-ecec-4e03-b998-c1c29217ac5e req-46633f5e-c824-4732-9f39-47bd2304bedc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040456 Apr 12 12:39:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 195/577] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:39:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61615) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:39:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-99b03eb1-fbd6-4c4a-a215-95f4cb6f0a75 req-6acf79af-9eeb-4bb2-b61b-48b16dcded15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045398 Apr 12 12:39:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 195/578] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:39:22 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:39:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-323c5836-5061-4dc5-8ddf-fc1a1a49ce36 req-adec483c-367f-49ad-b6f6-35ce277330a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048893 Apr 12 12:39:22 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 189/579] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:26 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:26 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:27 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:27 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-36b2d248-6be2-43c1-88e0-524b31026498 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 200 len: 1441 microversion: 2.1 time: 0.489455 Apr 12 12:39:27 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 196/580] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:26 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 1441 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] Creating event network-changed:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:39:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-29b891a8-14c6-4025-b617-45e15348c6c3 req-733d94bd-770b-45c1-a46d-4939f4be7158 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030498 Apr 12 12:39:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 196/581] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:39:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-bfff828a-9dd3-420e-a7c1-852bbc81ca9b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 204 len: 0 microversion: 2.1 time: 0.118341 Apr 12 12:39:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 190/582] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:39:29 2023] DELETE /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:29 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b9aa3ef7-d6e1-4995-86a5-587fb0899445 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 200 len: 1447 microversion: 2.1 time: 0.220415 Apr 12 12:39:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 197/583] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:29 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 1447 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "name": "network-vif-unplugged", "status": "completed", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] Creating event network-vif-unplugged:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:39:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-10b98e46-1e04-4182-8294-94e44b55abb7 req-2a08372b-5d62-4dce-bd97-783e13ff49e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103980 Apr 12 12:39:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 197/584] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "name": "network-vif-deleted", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] Creating event network-vif-deleted:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:39:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9bf5ab80-611f-4392-a3e1-9ea5e17cf5bc req-1d96c89f-f927-4019-ad06-6a80b32c5a30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Apr 12 12:39:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 191/585] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68378ff4-9b1d-4fa5-9b83-8f6c27541c63", "name": "network-vif-plugged", "status": "completed", "tag": "de8600c4-82e7-466e-88fc-6d625c2c0898"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:39:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] Creating event network-vif-plugged:de8600c4-82e7-466e-88fc-6d625c2c0898 for instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 on user Apr 12 12:39:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-b34f533d-5b27-4971-af49-42f26cb7418c req-727e7ff2-592d-4de6-a1e6-bf5011481edd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050941 Apr 12 12:39:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 198/586] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:34 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fae503f9-de59-4496-b666-323cb0610a93 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1552 microversion: 2.1 time: 0.191936 Apr 12 12:39:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 198/587] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:33 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1552 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:37 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7a19e2fb-1a21-4fdb-a682-7eb97790381b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1702 microversion: 2.1 time: 0.367363 Apr 12 12:39:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 192/588] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:36 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1702 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:41 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-42003a5c-0c23-44e7-b3c6-8e6d720ccca5 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1491 microversion: 2.1 time: 0.160897 Apr 12 12:39:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 199/589] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:41 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1491 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=24 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:39:58 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:39:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-77e6b9aa-9d7d-476c-8cf2-ffb36545813b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.151058 Apr 12 12:39:58 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 199/590] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:39:58 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:40:00 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 HTTP/1.1 Apr 12 12:40:00 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:40:00 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:40:00 user devstack@n-api.service[61616]: Connection: close Apr 12 12:40:00 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:40:00 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:40:00 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:40:00 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:40:00 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:40:00 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:40:00 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:40:00 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:40:00 user devstack@n-api.service[61616]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:40:00 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:40:00 user devstack@n-api.service[61616]: method: > Apr 12 12:40:00 user devstack@n-api.service[61616]: exception: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:40:00 user devstack@n-api.service[61616]: action_args: {'id': '9439468d-7a45-443b-87ce-106907761a56'} Apr 12 12:40:00 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:40:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:40:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7d35963f-79e4-45c8-b84a-dda95bc134e9 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 404 len: 111 microversion: 2.20 time: 0.051022 Apr 12 12:40:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 193/591] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:40:00 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:40:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-90126cb5-c49e-4e9f-94ec-0dfc041bb0f0 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '.version_select at 0x7fc95d1d56c0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=20 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-90126cb5-c49e-4e9f-94ec-0dfc041bb0f0 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250399543" status: 204 len: 0 microversion: 2.20 time: 0.025459 Apr 12 12:40:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 200/592] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 12:40:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250399543 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:40:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-79384f02-8ba1-4518-9e77-eeec64636c69 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: .version_select at 0x7fc95d24e9e0>, body: {"keypair": {"name": "tempest-keypair-2116396079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEkOEoNk45Nbu+gKXPJrgeuFyxP14yDmjujq5KBzAf1jdooM7if7PjnwRiQIghyJu3/D7EhyMQG3CM2jiTOS6YDsVIzsRhBe/9QtuVP0Mga6D+4x7iy56z4kNHaQEC8tg=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:01 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-79384f02-8ba1-4518-9e77-eeec64636c69 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:40:01 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-79384f02-8ba1-4518-9e77-eeec64636c69 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for user 46e4935eed324b868477f8e88918364a and project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:40:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-79384f02-8ba1-4518-9e77-eeec64636c69 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045151 Apr 12 12:40:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 200/593] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 12:40:01 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-615902404", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4ba97279-e122-4c2b-b931-dde33e1d71df"}], "security_groups": [{"name": "tempest-securitygroup--81040721"}], "key_name": "tempest-keypair-2116396079", "user_data": "}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] validate_networks() for [('4ba97279-e122-4c2b-b931-dde33e1d71df', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Getting quotas for user 46e4935eed324b868477f8e88918364a and project 5fec0c6dc7ab46b0b6b0a580252f40e3. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:40:03 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:40:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-0747b3e4-e11e-497b-8a24-e8b2dd29cc74 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.20 time: 0.765037 Apr 12 12:40:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 194/594] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 12:40:03 2023] POST /compute/v2.1/servers => generated 398 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:40:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:04 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:04 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:04 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:04 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-097bff39-20ef-489b-ad8a-53137c94105a tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1275 microversion: 2.20 time: 0.074145 Apr 12 12:40:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 201/595] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:40:04 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1275 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:40:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] Creating event network-changed:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:40:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a7418eef-6dbd-4135-95e9-bc4941209dd4 req-a4ff4499-4644-454f-8579-08000b79e1a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027641 Apr 12 12:40:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 201/596] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:40:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-a6ceed6c-b756-4511-a3dc-c737ae909610 req-a138f639-d6f3-47d2-a242-ccf6317e7b33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041701 Apr 12 12:40:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 195/597] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:40:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-e894bdb2-9edf-4ddb-b11f-43d081ca8fae req-9d643e65-17f4-4285-80f9-c1fa4116f1fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Apr 12 12:40:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 202/598] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:40:20 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 HTTP/1.1 Apr 12 12:40:20 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:40:20 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:40:20 user devstack@n-api.service[61615]: Connection: close Apr 12 12:40:20 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:40:20 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:40:20 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:40:20 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:40:20 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:40:20 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:40:20 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:40:20 user devstack@n-api.service[61615]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:40:20 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:40:20 user devstack@n-api.service[61615]: method: > Apr 12 12:40:20 user devstack@n-api.service[61615]: exception: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:40:20 user devstack@n-api.service[61615]: action_args: {'id': '68378ff4-9b1d-4fa5-9b83-8f6c27541c63'} Apr 12 12:40:20 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:40:20 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:40:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:40:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-dfa6f131-df90-43f0-9840-99e680eaa367 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 404 len: 111 microversion: 2.1 time: 0.036734 Apr 12 12:40:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 202/599] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:19 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1424711161", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1044387718", "security_groups": [{"name": "tempest-secgroup-smoke-200001683"}], "block_device_mapping_v2": [{"uuid": "b02750fc-665e-4715-9399-bb359cf6b1a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:40:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b02750fc-665e-4715-9399-bb359cf6b1a5',volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:40:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1ad0806d-4ea2-4199-9e50-60c0b2cc02d5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.791244 Apr 12 12:40:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 196/600] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:40:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:40:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0b88ab53-142c-4edd-831d-837c14af769b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0b88ab53-142c-4edd-831d-837c14af769b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:21 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-0b88ab53-142c-4edd-831d-837c14af769b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0b88ab53-142c-4edd-831d-837c14af769b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 200 len: 1090 microversion: 2.1 time: 0.087655 Apr 12 12:40:21 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 203/601] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:20 2023] GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 1090 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:40:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] Creating event network-changed:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:40:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-de08c9c6-8d7e-4cee-845b-d76be236e9fa req-959258a3-2582-4312-aff9-39886644291e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028733 Apr 12 12:40:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 203/602] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:40:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-6fe407bb-c07e-4adc-81de-e14ef0cd6f14 req-e3e250c8-57f9-4eb6-8ccc-40e04df2677e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054098 Apr 12 12:40:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 197/603] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:40:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c7f7bc1a-4bb5-463f-9a7c-59530b978da4 req-d5befbfe-1f57-4e61-b18a-17770bbfe0af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034746 Apr 12 12:40:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] Creating event network-changed:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:40:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0557371b-aa6e-4daf-aa82-0c111df48a85 req-667581b3-adaf-4c0e-af28-1da37ccbeed7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046244 Apr 12 12:40:35 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 204/605] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:35 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:40:35 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-935d3b66-7686-4e91-ba79-81e995aa64b8 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 204 len: 0 microversion: 2.1 time: 0.157310 Apr 12 12:40:35 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 198/606] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:40:35 2023] DELETE /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b62db7ef8e4ae4bc11ff520c6afcd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a894beccbd45af9d4486772fccb949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-42d47282-f83a-4389-913b-5076430f5f6f tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 200 len: 1558 microversion: 2.1 time: 0.198505 Apr 12 12:40:35 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 205/607] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:35 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-unplugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:35 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] Creating event network-vif-unplugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:40:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-54d36200-7fc7-4941-8eab-51b66f93be10 req-b7ceae88-5f7b-4f99-8351-e0ffae228fad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049633 Apr 12 12:40:35 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 205/608] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 while it is in vm_state rescued Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Request method failure captured: Apr 12 12:40:37 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments/2695aae0-2bb7-41a8-9f06-dd2df4aba06b HTTP/1.1 Apr 12 12:40:37 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:40:37 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:40:37 user devstack@n-api.service[61616]: Connection: close Apr 12 12:40:37 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:40:37 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:40:37 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:40:37 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:40:37 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPajtKreeen1BvBIukNq2K5bbAE4dQI4pcXQl4SrLk0qsljvifJsmSfn7qWZ3S9QTNAkC5zEscWQhQMgzZ0HKPefrSal9t_4fx76XBKSZMxu9qfg0YIRwx67buSlT1VmzOG-247FtoUg4U6aAHyZ03S78t-7XGs5SWONZ6wg-l1TLE Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Project-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Tenant-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:40:37 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:40:37 user devstack@n-api.service[61616]: X-User: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:40:37 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:40:37 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:40:37 user devstack@n-api.service[61616]: X-User-Id: 1db0203a6e6f4cc3bccbf19577a0c82f Apr 12 12:40:37 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:40:37 user devstack@n-api.service[61616]: method: > Apr 12 12:40:37 user devstack@n-api.service[61616]: exception: Cannot 'detach_volume' instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 while it is in vm_state rescued Apr 12 12:40:37 user devstack@n-api.service[61616]: action_args: {'server_id': '89cc5f86-c387-4966-8bbf-a64d42d30db7', 'id': '2695aae0-2bb7-41a8-9f06-dd2df4aba06b'} Apr 12 12:40:37 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 while it is in vm_state rescued Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 while it is in vm_state rescued Apr 12 12:40:37 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Returning 409 to user: Cannot 'detach_volume' instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 while it is in vm_state rescued {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:40:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5b7a1c28-e40c-4dc7-8f60-94ffc83e67ae tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments/2695aae0-2bb7-41a8-9f06-dd2df4aba06b" status: 409 len: 152 microversion: 2.1 time: 0.108969 Apr 12 12:40:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 199/609] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:40:37 2023] DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments/2695aae0-2bb7-41a8-9f06-dd2df4aba06b => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c919b799-7f4a-4fff-a25f-9d0e9a5d77d7 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/action" status: 202 len: 0 microversion: 2.1 time: 0.076320 Apr 12 12:40:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 206/610] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:40:37 2023] POST /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a668dfda-77e9-4727-87f7-9d43c40d4e9b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1710 microversion: 2.1 time: 0.164527 Apr 12 12:40:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 206/611] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:37 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-plugged", "status": "completed", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}, {"server_uuid": "fa011231-049f-40c3-89c0-53447a35752f", "name": "network-vif-deleted", "tag": "8243f136-fe60-498f-80e1-27a598c434a3"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Creating event network-vif-plugged:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:40:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] Creating event network-vif-deleted:8243f136-fe60-498f-80e1-27a598c434a3 for instance fa011231-049f-40c3-89c0-53447a35752f on user Apr 12 12:40:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-bef24c3c-7188-4ac0-8dfd-13f3837ff413 req-ecc3e8fa-f098-44ea-befa-f78e008f49df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033966 Apr 12 12:40:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 200/612] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-unplugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] Creating event network-vif-unplugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:40:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-58ec9b88-4740-4c00-ae66-67d382789dd3 req-20d41d58-77b0-424e-a9a3-1a0dbb56ba4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046901 Apr 12 12:40:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 207/613] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:40:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:40:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-eeb1ee39-8cf1-4ffe-a68f-4a19e53d65c2 req-b5c58735-4c65-4e66-8ae8-ed67ea07a3a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035218 Apr 12 12:40:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 207/614] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:40:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-564e2728-b4cc-4f1e-b571-d16ca320256c req-f306fb61-1017-4688-954f-848318565db6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047050 Apr 12 12:40:42 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 201/615] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:40:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:40:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-eff77fb7-03e5-4dc2-b295-ab2bd4bcb67d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-386158289", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "destination_type": "local"}, {"source_type": "volume", "uuid": "a18842a9-40d4-442f-82a2-827131cd8b22", "destination_type": "invalid"}], "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:40:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-eff77fb7-03e5-4dc2-b295-ab2bd4bcb67d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:40:44 user devstack@n-api.service[61614]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 12:40:44 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:40:44 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:40:44 user devstack@n-api.service[61614]: Connection: close Apr 12 12:40:44 user devstack@n-api.service[61614]: Content-Length: 493 Apr 12 12:40:44 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:40:44 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:40:44 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:40:44 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:40:44 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:40:44 user devstack@n-api.service[61614]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:40:44 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:40:44 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:40:44 user devstack@n-api.service[61614]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:40:44 user devstack@n-api.service[61614]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:40:44 user devstack@n-api.service[61614]: Apr 12 12:40:44 user devstack@n-api.service[61614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-386158289", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "destination_type": "local"}, {"source_type": "volume", "uuid": "a18842a9-40d4-442f-82a2-827131cd8b22", "destination_type": "invalid"}], "networks": [{"uuid": "963759e8-808d-494c-9dea-0efa9f78804a"}]}} Apr 12 12:40:44 user devstack@n-api.service[61614]: method: > Apr 12 12:40:44 user devstack@n-api.service[61614]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 12:40:44 user devstack@n-api.service[61614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-386158289', 'imageRef': '10cdaa6e-1722-4d2a-835d-7b112d771c50', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '10cdaa6e-1722-4d2a-835d-7b112d771c50', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a18842a9-40d4-442f-82a2-827131cd8b22', 'destination_type': 'invalid'}], 'networks': [{'uuid': '963759e8-808d-494c-9dea-0efa9f78804a'}]}}} Apr 12 12:40:44 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise error Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 12:40:44 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:40:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-eff77fb7-03e5-4dc2-b295-ab2bd4bcb67d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:40:44 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-eff77fb7-03e5-4dc2-b295-ab2bd4bcb67d tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010472 Apr 12 12:40:44 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 208/616] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:40:44 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:44 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-63cbe3bc-2fee-4c19-8c7c-165f08a9d8ea tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1491 microversion: 2.1 time: 0.148281 Apr 12 12:40:44 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 208/617] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:44 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1491 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:54 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e3c86841-68a4-4ee1-add9-dbc7feddc8d8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1584 microversion: 2.20 time: 0.174550 Apr 12 12:40:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 202/618] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:40:54 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1584 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:58 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b9af4186-bcdf-4051-a3db-8d29e9e38bf8 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.155682 Apr 12 12:40:58 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 209/619] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:58 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=10 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=18 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:40:58 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:40:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f31b9820-4e97-4642-9f3c-1b3ff23af0eb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1724 microversion: 2.1 time: 0.144310 Apr 12 12:40:58 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 209/620] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:40:58 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1effa6e8-5317-41cc-bf76-cefef2566eb3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 200 len: 1440 microversion: 2.1 time: 0.153758 Apr 12 12:41:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 203/621] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:11 2023] GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 1440 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] [instance: fa011231-049f-40c3-89c0-53447a35752f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] HTTP exception thrown: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Request method failure captured: Apr 12 12:41:25 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f HTTP/1.1 Apr 12 12:41:25 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:41:25 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:41:25 user devstack@n-api.service[61614]: Connection: close Apr 12 12:41:25 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:41:25 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:41:25 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:41:25 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:41:25 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqVmT0sRedpGXNVD-eZNm4od02SU1FmMevrHPCiqY5no6RSpjU30RhYeRM7TjNabtB38PmAc4uVKa3nhSrwxk3sNtcfFXhKQzTDk6X94GwHPGHxZE90iK4qNEmWK1opZU-mF2jI5U_L2OXpF8ixjK-xzGQv5aVAIlS65SW-eAfWrDK4 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Project-Id: 99a894beccbd45af9d4486772fccb949 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Project-Name: tempest-TestShelveInstance-1585323339 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99a894beccbd45af9d4486772fccb949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/99a894beccbd45af9d4486772fccb949"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99a894beccbd45af9d4486772fccb949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Tenant: tempest-TestShelveInstance-1585323339 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Tenant-Id: 99a894beccbd45af9d4486772fccb949 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TestShelveInstance-1585323339 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-User: tempest-TestShelveInstance-1585323339-project-member Apr 12 12:41:25 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:41:25 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:41:25 user devstack@n-api.service[61614]: X-User-Id: b4b62db7ef8e4ae4bc11ff520c6afcd8 Apr 12 12:41:25 user devstack@n-api.service[61614]: X-User-Name: tempest-TestShelveInstance-1585323339-project-member Apr 12 12:41:25 user devstack@n-api.service[61614]: method: > Apr 12 12:41:25 user devstack@n-api.service[61614]: exception: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. Apr 12 12:41:25 user devstack@n-api.service[61614]: action_args: {'id': 'fa011231-049f-40c3-89c0-53447a35752f'} Apr 12 12:41:25 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. Apr 12 12:41:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Returning 404 to user: Instance fa011231-049f-40c3-89c0-53447a35752f could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:41:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-32e15452-ce84-4823-8ffa-69c0bbc05b78 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f" status: 404 len: 111 microversion: 2.1 time: 0.065762 Apr 12 12:41:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:25 2023] GET /compute/v2.1/servers/fa011231-049f-40c3-89c0-53447a35752f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:41:25 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-51dc42ac-cabf-4942-8c89-d85371b6a4d1 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] Calling method '.version_select at 0x7fc95d4b0dc0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:25 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:25 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:25 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-51dc42ac-cabf-4942-8c89-d85371b6a4d1 tempest-TestShelveInstance-1585323339 tempest-TestShelveInstance-1585323339-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-568010420" status: 202 len: 0 microversion: 2.1 time: 0.043442 Apr 12 12:41:25 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 210/623] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 12:41:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-568010420 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:27 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-57d5a718-37b2-4c3a-984e-3dc9489665ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1716 microversion: 2.1 time: 0.281691 Apr 12 12:41:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 204/624] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:27 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1716 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] HTTP exception thrown: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:41:49 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 HTTP/1.1 Apr 12 12:41:49 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:41:49 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:41:49 user devstack@n-api.service[61614]: Connection: close Apr 12 12:41:49 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:41:49 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:41:49 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:41:49 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:41:49 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:41:49 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61614]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:41:49 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:41:49 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:41:49 user devstack@n-api.service[61614]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:41:49 user devstack@n-api.service[61614]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:41:49 user devstack@n-api.service[61614]: method: > Apr 12 12:41:49 user devstack@n-api.service[61614]: exception: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61614]: action_args: {'id': 'fe72c043-e035-4926-8f7f-455285f0dbe8'} Apr 12 12:41:49 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 404 to user: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:41:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2aa9e3d7-c91c-4454-b3a0-76676fa78a61 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 404 len: 111 microversion: 2.1 time: 0.045646 Apr 12 12:41:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 211/625] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:41:49 2023] DELETE /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: fe72c043-e035-4926-8f7f-455285f0dbe8] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] HTTP exception thrown: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:41:49 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 HTTP/1.1 Apr 12 12:41:49 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:41:49 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:41:49 user devstack@n-api.service[61615]: Connection: close Apr 12 12:41:49 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:41:49 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:41:49 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:41:49 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:41:49 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:41:49 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:41:49 user devstack@n-api.service[61615]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:41:49 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:41:49 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:41:49 user devstack@n-api.service[61615]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:41:49 user devstack@n-api.service[61615]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:41:49 user devstack@n-api.service[61615]: method: > Apr 12 12:41:49 user devstack@n-api.service[61615]: exception: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61615]: action_args: {'id': 'fe72c043-e035-4926-8f7f-455285f0dbe8'} Apr 12 12:41:49 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. Apr 12 12:41:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 404 to user: Instance fe72c043-e035-4926-8f7f-455285f0dbe8 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:41:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-74cc3c87-35ac-4965-a1f3-87f4d13b3011 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8" status: 404 len: 111 microversion: 2.1 time: 0.041558 Apr 12 12:41:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 211/626] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:49 2023] GET /compute/v2.1/servers/fe72c043-e035-4926-8f7f-455285f0dbe8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:41:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7feadb14-3b5a-4043-82f1-2bd4e4cef653 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 204 len: 0 microversion: 2.1 time: 0.139660 Apr 12 12:41:49 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 205/627] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:41:49 2023] DELETE /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc42504b7aab4fedb136acd998adeddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab04e4f968f4c07af43f3fe6651713a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ff70aa28-eb5c-4948-92aa-601330be3997 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 200 len: 1497 microversion: 2.1 time: 0.208451 Apr 12 12:41:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 212/628] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:49 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "name": "network-vif-unplugged", "status": "completed", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] Creating event network-vif-unplugged:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:41:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-b84108ee-7c81-420b-8464-b0e0cd887f6a req-d717f021-9fb0-41ff-9b58-1da8b3b84b13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201411 Apr 12 12:41:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 212/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:41:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:41:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "name": "network-vif-deleted", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] Creating event network-vif-deleted:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:41:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-d37361d7-4313-4857-a273-42c5a600a722 req-05f57ae2-fb73-4a06-acdb-545140196db2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034930 Apr 12 12:41:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 206/630] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:41:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:41:51 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8403a098-a141-4feb-9eed-3731e2c7c152", "name": "network-vif-plugged", "status": "completed", "tag": "12dd9e3e-1713-4f14-8893-3084e8140f87"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:51 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] Creating event network-vif-plugged:12dd9e3e-1713-4f14-8893-3084e8140f87 for instance 8403a098-a141-4feb-9eed-3731e2c7c152 on user Apr 12 12:41:51 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-fa5636ab-99e8-49b6-b5fe-f9bd4ed06db5 req-83674176-4a43-4fdd-8d0c-aa8af11ab525 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031421 Apr 12 12:41:51 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 213/631] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:41:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-46092b0d-b0ee-4224-9def-939ffff2e015 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.090476 Apr 12 12:41:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 213/632] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 12:41:54 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:41:55 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] Creating event network-changed:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:41:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9ddf0e59-901b-4f04-be0f-753dcc1ad63d req-67c645b2-907a-4c1c-9167-962570eff584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032984 Apr 12 12:41:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 207/633] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-da3fb5c9-2555-46c1-a338-2bcdd601ba03 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/ips" status: 200 len: 109 microversion: 2.20 time: 0.034638 Apr 12 12:41:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 214/634] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 12:41:55 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/ips => generated 109 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:56 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lazy-loading 'flavor' on Instance uuid 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:41:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0a3d239c-020c-4e90-b170-9230dda75607 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/action" status: 202 len: 0 microversion: 2.20 time: 0.903079 Apr 12 12:41:57 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 214/635] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:41:56 2023] POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/action => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:57 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:57 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-03365364-c0b6-4382-8e54-229d47882cdf tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1709 microversion: 2.20 time: 0.204213 Apr 12 12:41:57 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 208/636] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:41:57 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1709 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:41:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-unplugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:41:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] Creating event network-vif-unplugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:41:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-603f9abc-28f2-421b-867f-8c585ed5bb21 req-054949a2-d0a2-48a1-89eb-f31a5ffab92c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028898 Apr 12 12:41:58 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 215/637] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:41:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:58 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:41:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9966f7f5-ec9f-43df-a514-332d432ad07a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 204 len: 0 microversion: 2.1 time: 0.173237 Apr 12 12:41:58 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 215/638] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:41:58 2023] DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:41:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:41:58 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:41:59 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:41:59 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d4745ea7-f4a5-4e52-84b9-4e6ef9a356f4 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 200 len: 1730 microversion: 2.1 time: 0.181570 Apr 12 12:41:59 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 209/639] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:41:58 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:42:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}, {"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-unplugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}, {"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-plugged", "status": "completed", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:42:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Creating event network-vif-unplugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:42:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] Creating event network-vif-plugged:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:42:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f5a84fad-ed25-4925-9e00-64e206bbee98 req-5ce08749-b0b8-45cd-875a-2b0c64a480e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033544 Apr 12 12:42:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 216/640] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:00 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546c0c08-35f1-4043-ac30-56d49bc86af1", "name": "network-vif-deleted", "tag": "6f21df63-1895-4500-b119-c4670a7f3569"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] Creating event network-vif-deleted:6f21df63-1895-4500-b119-c4670a7f3569 for instance 546c0c08-35f1-4043-ac30-56d49bc86af1 on user Apr 12 12:42:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-888a4625-4ce3-43e5-aa86-f6c72a919ad0 req-42b1d487-0088-467d-9350-0cf14606ba07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Apr 12 12:42:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 216/641] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.compute.server_external_events [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] Unable to find a host for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5. Dropping event network-changed {{(pid=61616) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 12 12:42:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-ca100676-d2c9-496f-a8c3-62a666fc5eba req-c335f116-baa4-418d-abbf-ee97609f0812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.025219 Apr 12 12:42:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 210/642] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=18 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:11 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-96a6df13-1270-4573-a890-ae3aa93c47f1 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 200 len: 1440 microversion: 2.1 time: 0.186426 Apr 12 12:42:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 217/643] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:11 2023] GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 1440 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] Creating event network-changed:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:42:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0d29ee6c-b47b-4e83-866d-0b9f6fafec8c req-b015f658-23a5-420a-a1e7-7a0f5aa473f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042989 Apr 12 12:42:12 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 217/644] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:18 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55213853", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1044387718", "security_groups": [{"name": "tempest-secgroup-smoke-200001683"}], "block_device_mapping_v2": [{"uuid": "8d51c851-3ddf-4ff7-bdc0-982cf356bc0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b2275f8-865d-4425-a1b0-0d308b5dcd1b"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:18 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:18 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] validate_networks() for [('7b2275f8-865d-4425-a1b0-0d308b5dcd1b', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Getting quotas for user 076e65b43f664765ad1d48be6e814f40 and project 5ada441da2124adda751365952320e81. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:42:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d51c851-3ddf-4ff7-bdc0-982cf356bc0d',volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:42:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-da12c4de-fd29-4c22-baee-debe1136858d tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.687973 Apr 12 12:42:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 211/645] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:42:18 2023] POST /compute/v2.1/servers => generated 403 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:42:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-ff7a29dd-cbd1-49ea-8278-f49d3f76aab3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-ff7a29dd-cbd1-49ea-8278-f49d3f76aab3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-ff7a29dd-cbd1-49ea-8278-f49d3f76aab3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-ff7a29dd-cbd1-49ea-8278-f49d3f76aab3 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 200 len: 1088 microversion: 2.1 time: 0.063951 Apr 12 12:42:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 218/646] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:19 2023] GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:42:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] Creating event network-changed:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:42:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-ab2af09b-0a20-4a9a-acb8-29ed4954f7a2 req-11e5678d-3599-4e88-b402-4db0c8b17050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031683 Apr 12 12:42:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 218/647] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-bc001b5a-3ac5-47ac-9edf-fe7edfa6124d tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.115710 Apr 12 12:42:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 212/648] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:42:28 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "name": "network-vif-plugged", "status": "completed", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] Creating event network-vif-plugged:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:42:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-68069ae5-3e9c-47bb-b365-5663ccaf4e26 req-741d1ee9-1fd3-4fb1-883c-a0a9989c37c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036343 Apr 12 12:42:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 219/649] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:29 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lazy-loading 'services' on Instance uuid 89cc5f86-c387-4966-8bbf-a64d42d30db7 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:42:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1b8820b3-f057-4cd5-9999-896f3c38f0ef tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments/2695aae0-2bb7-41a8-9f06-dd2df4aba06b" status: 202 len: 0 microversion: 2.1 time: 0.169114 Apr 12 12:42:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 219/650] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:42:29 2023] DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments/2695aae0-2bb7-41a8-9f06-dd2df4aba06b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-19eab860-f7f0-4667-8bff-f3399798c4ee tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066106 Apr 12 12:42:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 213/651] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:42:30 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "name": "network-vif-plugged", "status": "completed", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}, {"name": "network-changed", "server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"name": "network-changed", "server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Creating event network-vif-plugged:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:42:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Creating event network-changed:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:42:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] Creating event network-changed:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:42:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-7e7c90c0-0214-4706-b844-d7ec59e6d6a4 req-6c03b276-998b-49c3-a176-e4b9414e1ced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.037583 Apr 12 12:42:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 220/652] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] [instance: 8403a098-a141-4feb-9eed-3731e2c7c152] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] HTTP exception thrown: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Request method failure captured: Apr 12 12:42:39 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 HTTP/1.1 Apr 12 12:42:39 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:42:39 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:42:39 user devstack@n-api.service[61615]: Connection: close Apr 12 12:42:39 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:42:39 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:42:39 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:42:39 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:42:39 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqUBz4B5ZRNXRjTWESqmqylEo9k4ciWC_XeENqvzf62VOTd1NShfh-a9LzsrS1Wrq7z6g9w7j5CJ6w8037xxeAPo1OdvZqKNzV3tAPIBrhMTlczhyQCp_G7tNceG-S2rrCRqprlrorDHUlul6pZdTguUKjAZ5Q4FGFhFxTG_CGQqeIE Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Project-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ab04e4f968f4c07af43f3fe6651713a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Tenant: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Tenant-Id: 7ab04e4f968f4c07af43f3fe6651713a Apr 12 12:42:39 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331801987 Apr 12 12:42:39 user devstack@n-api.service[61615]: X-User: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:42:39 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:42:39 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:42:39 user devstack@n-api.service[61615]: X-User-Id: bc42504b7aab4fedb136acd998adeddb Apr 12 12:42:39 user devstack@n-api.service[61615]: X-User-Name: tempest-ServersNegativeTestJSON-1331801987-project-member Apr 12 12:42:39 user devstack@n-api.service[61615]: method: > Apr 12 12:42:39 user devstack@n-api.service[61615]: exception: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. Apr 12 12:42:39 user devstack@n-api.service[61615]: action_args: {'id': '8403a098-a141-4feb-9eed-3731e2c7c152'} Apr 12 12:42:39 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. Apr 12 12:42:39 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] Returning 404 to user: Instance 8403a098-a141-4feb-9eed-3731e2c7c152 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:42:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-42216609-e5b8-4db8-b750-4c9f8444a2a7 tempest-ServersNegativeTestJSON-1331801987 tempest-ServersNegativeTestJSON-1331801987-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152" status: 404 len: 111 microversion: 2.1 time: 0.033883 Apr 12 12:42:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:39 2023] GET /compute/v2.1/servers/8403a098-a141-4feb-9eed-3731e2c7c152 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:47 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:48 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:48 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:48 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b01fd03d-2dfc-4f33-8631-21ae8cf53644 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1650 microversion: 2.20 time: 0.174831 Apr 12 12:42:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 214/654] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:42:47 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:42:49 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 HTTP/1.1 Apr 12 12:42:49 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:42:49 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:42:49 user devstack@n-api.service[61614]: Connection: close Apr 12 12:42:49 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:42:49 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:42:49 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:42:49 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:42:49 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61614]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61614]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:42:49 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61614]: method: > Apr 12 12:42:49 user devstack@n-api.service[61614]: exception: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61614]: action_args: {'id': '546c0c08-35f1-4043-ac30-56d49bc86af1'} Apr 12 12:42:49 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:42:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-f8ce0e37-d283-4eb4-9499-42c1ff4fa5fa tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 404 len: 111 microversion: 2.1 time: 0.042646 Apr 12 12:42:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 221/655] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:49 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:42:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:42:49 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments HTTP/1.1 Apr 12 12:42:49 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:42:49 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:42:49 user devstack@n-api.service[61615]: Connection: close Apr 12 12:42:49 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:42:49 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:42:49 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:42:49 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:42:49 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61615]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61615]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:42:49 user devstack@n-api.service[61615]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61615]: method: > Apr 12 12:42:49 user devstack@n-api.service[61615]: exception: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61615]: action_args: {'server_id': '546c0c08-35f1-4043-ac30-56d49bc86af1'} Apr 12 12:42:49 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:42:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7770f9ec-68d2-45a5-9696-6503633cfde9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051268 Apr 12 12:42:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 221/656] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:42:49 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:42:49 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 HTTP/1.1 Apr 12 12:42:49 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:42:49 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:42:49 user devstack@n-api.service[61616]: Connection: close Apr 12 12:42:49 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:42:49 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:42:49 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:42:49 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:42:49 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:42:49 user devstack@n-api.service[61616]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:42:49 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:42:49 user devstack@n-api.service[61616]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:42:49 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:42:49 user devstack@n-api.service[61616]: method: > Apr 12 12:42:49 user devstack@n-api.service[61616]: exception: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61616]: action_args: {'id': '546c0c08-35f1-4043-ac30-56d49bc86af1'} Apr 12 12:42:49 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:42:49 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:42:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:42:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-548e7d72-f0b7-4b13-a670-109932e5662a tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 404 len: 111 microversion: 2.1 time: 0.031603 Apr 12 12:42:49 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 215/657] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:49 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1256098765", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "6bd5aca2-dc12-4f05-af95-523f7a183a5d"}], "security_groups": [{"name": "tempest-securitygroup--1251524765"}], "key_name": "tempest-keypair-1245622558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:49 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] validate_networks() for [('6bd5aca2-dc12-4f05-af95-523f7a183a5d', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:42:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:42:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-90d6deb1-c515-44c7-b231-fc483cfb38e1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.825774 Apr 12 12:42:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 222/658] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:42:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:42:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-aed7d7a5-80ad-4d1b-b358-0b0cfb535808 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:42:50 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-aed7d7a5-80ad-4d1b-b358-0b0cfb535808 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:42:50 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-aed7d7a5-80ad-4d1b-b358-0b0cfb535808 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:42:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-aed7d7a5-80ad-4d1b-b358-0b0cfb535808 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 200 len: 1233 microversion: 2.1 time: 0.069740 Apr 12 12:42:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 222/659] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:42:50 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 1233 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:42:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] Creating event network-changed:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:42:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-06ac94c5-66a5-409b-90b0-35ba8fe433ff req-33222deb-81a9-410f-b91a-6701fa2fbeb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043278 Apr 12 12:42:53 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 216/660] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:55 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "name": "network-vif-plugged", "status": "completed", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] Creating event network-vif-plugged:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:42:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f29ccda8-9568-4cc7-98f4-d476ce79d87c req-e9d8f139-3f50-422e-8818-4f14a08b0dab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053193 Apr 12 12:42:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 223/661] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:42:57 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "name": "network-vif-plugged", "status": "completed", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:42:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:42:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:42:57 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:42:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] Creating event network-vif-plugged:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:42:57 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-b831db8f-a2f7-4f68-bc00-4298a3889359 req-fa4156b9-6f54-4bd4-952f-fe4422061a15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028373 Apr 12 12:42:57 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 223/662] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:09 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a3ccb8d3-9cfc-4769-9868-dedcfeef46d8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 200 len: 1438 microversion: 2.1 time: 0.150109 Apr 12 12:43:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 217/663] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:43:09 2023] GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-9ae2d18a-ec6b-4d2e-be51-9ef5be23f393 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058468 Apr 12 12:43:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 224/664] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:43:20 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=7 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:43:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5f660bd9-dc4e-472f-bff7-61b5506c2a78 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 204 len: 0 microversion: 2.1 time: 0.138231 Apr 12 12:43:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 224/665] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:43:20 2023] DELETE /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-6cae161a-0982-4dea-895d-d8ff6dac8671 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 200 len: 1676 microversion: 2.1 time: 0.202262 Apr 12 12:43:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 218/666] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:43:20 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-unplugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] Creating event network-vif-unplugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-726eaa54-346e-4322-9b30-d95c0aaf056e req-10db4816-c106-462d-9cce-b8c6d798f71f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030361 Apr 12 12:43:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 225/667] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-deleted", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] Creating event network-vif-deleted:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-c0e429e9-7e27-4be0-ae40-1f5f0453d947 req-181e403c-d4d3-4f53-8b32-2882a0e5c43a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033250 Apr 12 12:43:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 225/668] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:22 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-unplugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}, {"server_uuid": "89cc5f86-c387-4966-8bbf-a64d42d30db7", "name": "network-vif-plugged", "status": "completed", "tag": "c3155961-f301-4a26-a599-1d648d2500b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Creating event network-vif-unplugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] Creating event network-vif-plugged:c3155961-f301-4a26-a599-1d648d2500b0 for instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 on user Apr 12 12:43:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-0f9a7661-62dd-46ca-a0cd-a912b01cca81 req-6525e150-5d20-4d42-bc5e-89b8bf861be4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036650 Apr 12 12:43:22 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 219/669] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:22 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-f488dc89-3b23-49a0-8c15-976934d09ee3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 200 len: 1541 microversion: 2.1 time: 0.346704 Apr 12 12:43:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 226/670] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:43:40 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 1541 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:43:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1074373312", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "eaded3a8-c825-4731-95bc-3f39f32603da"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] validate_networks() for [('eaded3a8-c825-4731-95bc-3f39f32603da', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting quotas for project bfd0006105e24edb9516d52c5af63054. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting quotas for user 2b3792e5a3b24583bbf50fb2b275b6d0 and project bfd0006105e24edb9516d52c5af63054. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:43:42 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:43:42 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7ffe683b-fd90-46f0-869f-724e98f8e1a0 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.710366 Apr 12 12:43:42 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 226/671] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:43:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 12 12:43:42 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:42 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:43:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-131b6f9d-4719-4377-90cd-715d16a3a5bf tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:42 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-131b6f9d-4719-4377-90cd-715d16a3a5bf tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:42 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-131b6f9d-4719-4377-90cd-715d16a3a5bf tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-131b6f9d-4719-4377-90cd-715d16a3a5bf tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e" status: 200 len: 1208 microversion: 2.1 time: 0.126574 Apr 12 12:43:42 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 220/672] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:43:42 2023] GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:43:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] Creating event network-changed:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:43:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a8c59d0e-38af-452f-8a07-f1004cd58474 req-573a2fd0-9e3e-42a8-8d46-a4b04c85e333 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120434 Apr 12 12:43:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 227/673] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "name": "network-vif-plugged", "status": "completed", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:47 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] Creating event network-vif-plugged:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:43:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f8013bb6-07bc-4dfd-8c02-13299dc74eac req-d28b3107-59ee-4d04-a17c-667da8e396ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049981 Apr 12 12:43:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 227/674] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75e57740-f839-47e6-aea8-cdaec828db5f"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4d827cc0-5ea4-41d1-bf32-b84e29b0ffa4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.469733 Apr 12 12:43:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 221/675] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 12:43:48 2023] POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments => generated 188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-985bd2f2-f8c4-4339-aa71-b4b670bc9446 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments/75e57740-f839-47e6-aea8-cdaec828db5f" status: 202 len: 0 microversion: 2.20 time: 0.275311 Apr 12 12:43:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 228/676] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 12:43:48 2023] DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments/75e57740-f839-47e6-aea8-cdaec828db5f => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61615) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 12:43:49 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-587ff2d8-c909-42e7-954c-687b432b37fd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/action" status: 202 len: 0 microversion: 2.20 time: 0.136559 Apr 12 12:43:49 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 228/677] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:43:49 2023] POST /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "name": "network-vif-plugged", "status": "completed", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] Creating event network-vif-plugged:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:43:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9ee1df2c-d0b7-4970-98d2-155539ee63d8 req-4f52ee2f-9af6-43e5-bae2-45dcbb7f0134 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Apr 12 12:43:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 229/678] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:49 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:43:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-859892bb-8ad2-452f-a7bf-203091e94cee tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1658 microversion: 2.20 time: 0.170421 Apr 12 12:43:49 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 222/679] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:43:49 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1658 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:43:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] Creating event network-changed:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:43:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a852fb97-8528-4568-a9b4-26694f1bf401 req-c4341513-9d07-4b7b-90c4-dde9787364d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083803 Apr 12 12:43:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 229/680] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:43:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:43:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:43:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:43:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:43:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:43:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-3eecfd30-4989-475d-9567-dac39e8493db req-8fdc595e-1fff-4ecf-b4ca-f0c8fae98536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040599 Apr 12 12:43:58 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 230/681] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:44:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-0fa20d79-bf9f-4a5f-a9c6-26189b917a43 req-a55800f0-04e2-4abf-9d84-cbe9839b37e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066029 Apr 12 12:44:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 223/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:10 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-e05e4db1-45e4-4e05-bf80-7bd065c54576 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 200 len: 1438 microversion: 2.1 time: 0.284004 Apr 12 12:44:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 230/683] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:10 2023] GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 1438 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 89cc5f86-c387-4966-8bbf-a64d42d30db7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HTTP exception thrown: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Request method failure captured: Apr 12 12:44:10 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 HTTP/1.1 Apr 12 12:44:10 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:44:10 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:44:10 user devstack@n-api.service[61614]: Connection: close Apr 12 12:44:10 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:44:10 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:44:10 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:44:10 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:44:10 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPajtKreeen1BvBIukNq2K5bbAE4dQI4pcXQl4SrLk0qsljvifJsmSfn7qWZ3S9QTNAkC5zEscWQhQMgzZ0HKPefrSal9t_4fx76XBKSZMxu9qfg0YIRwx67buSlT1VmzOG-247FtoUg4U6aAHyZ03S78t-7XGs5SWONZ6wg-l1TLE Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Project-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Tenant-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:44:10 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:44:10 user devstack@n-api.service[61614]: X-User: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:44:10 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:44:10 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:44:10 user devstack@n-api.service[61614]: X-User-Id: 1db0203a6e6f4cc3bccbf19577a0c82f Apr 12 12:44:10 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:44:10 user devstack@n-api.service[61614]: method: > Apr 12 12:44:10 user devstack@n-api.service[61614]: exception: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. Apr 12 12:44:10 user devstack@n-api.service[61614]: action_args: {'id': '89cc5f86-c387-4966-8bbf-a64d42d30db7'} Apr 12 12:44:10 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. Apr 12 12:44:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:44:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Returning 404 to user: Instance 89cc5f86-c387-4966-8bbf-a64d42d30db7 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:44:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8e926022-ed6c-4ee0-8216-2c115f6d7a05 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7" status: 404 len: 111 microversion: 2.1 time: 0.041183 Apr 12 12:44:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 231/684] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:10 2023] GET /compute/v2.1/servers/89cc5f86-c387-4966-8bbf-a64d42d30db7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:44:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5e3713fa-3a0d-4677-a93a-edb2db23e689 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '.version_select at 0x7fc95c134c10>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5e3713fa-3a0d-4677-a93a-edb2db23e689 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856573039" status: 202 len: 0 microversion: 2.1 time: 0.030666 Apr 12 12:44:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 224/685] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 12:44:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856573039 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:44:12 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:12 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] Creating event network-changed:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:44:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-808fe832-be88-4318-8a10-33190fca936c req-5cedd400-985a-4613-aac2-fb96b25b909c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039280 Apr 12 12:44:12 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 231/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] Creating event network-changed:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:44:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-1696cecd-f422-4336-a371-d3cb0b40cda9 req-c05a1642-85d5-481f-a797-ca19051d1667 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033484 Apr 12 12:44:13 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 225/687] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:13 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:44:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4f47f5d4-2871-4743-a251-e34b7a9d11ea tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 204 len: 0 microversion: 2.1 time: 0.160856 Apr 12 12:44:13 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 232/688] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:44:13 2023] DELETE /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:13 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-73b6c04d-16fe-4657-8e6a-8022c73ac8f8 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 200 len: 1563 microversion: 2.1 time: 0.281063 Apr 12 12:44:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 232/689] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:13 2023] GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 1563 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:44:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "name": "network-vif-deleted", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] Creating event network-vif-deleted:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:44:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3bf40370-5ee6-4339-ace7-3f112425cf85 req-2f624627-ca74-4e26-99d6-af92beae81c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Apr 12 12:44:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 226/690] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "name": "network-vif-unplugged", "status": "completed", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}, {"server_uuid": "88e09fde-0a42-4066-b1f5-413903476735", "name": "network-vif-plugged", "status": "completed", "tag": "bf3129f6-4466-41a8-a974-86182f2e209e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Creating event network-vif-unplugged:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:44:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] Creating event network-vif-plugged:bf3129f6-4466-41a8-a974-86182f2e209e for instance 88e09fde-0a42-4066-b1f5-413903476735 on user Apr 12 12:44:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f82e90da-fac5-4a3c-8ea2-3d50b4582ae6 req-d9d446d9-e476-4291-b809-df1f56ebe8b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034017 Apr 12 12:44:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 233/691] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:44:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-21d41bb5-61f6-4b6b-88ab-e208d8301dd5 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 204 len: 0 microversion: 2.1 time: 0.124466 Apr 12 12:44:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 233/692] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:44:16 2023] DELETE /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:16 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7a1e2672-96f1-421c-afe8-5d903248b734 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 200 len: 1496 microversion: 2.1 time: 0.237231 Apr 12 12:44:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 227/693] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:16 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 1496 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:44:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-unplugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}, {"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-plugged", "status": "completed", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Creating event network-vif-unplugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:44:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] Creating event network-vif-plugged:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:44:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-b549fdfb-dac4-4ec1-9052-71a849417f43 req-3465afde-ed69-41ac-b7b9-f681a2bdd36b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030878 Apr 12 12:44:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 234/694] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4107f2d-88e4-4846-9ece-cb16ad7ecd02", "name": "network-vif-deleted", "tag": "5680054b-9363-4825-ade2-add800d7142b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] Creating event network-vif-deleted:5680054b-9363-4825-ade2-add800d7142b for instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 on user Apr 12 12:44:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-46f4c420-3550-48fd-b59c-4bcf62767aa1 req-95593cae-e297-4e40-a35e-911d5d091205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Apr 12 12:44:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 234/695] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:32 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4ba13255-a8d1-4857-9a17-23400e66a9c7 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e" status: 200 len: 1486 microversion: 2.1 time: 0.146950 Apr 12 12:44:32 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 228/696] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:32 2023] GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e => generated 1486 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:39 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-25ed62b8-0141-46b1-a5c9-7ec156f53b1f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1703 microversion: 2.20 time: 0.168271 Apr 12 12:44:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 235/697] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:44:39 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1703 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-39667eee-823a-4459-85dd-3f51143c674b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.217363 Apr 12 12:44:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 235/698] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:44:41 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7/os-interface => generated 283 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] Creating event network-changed:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:44:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-0931750a-36c2-4f84-a467-364231cb8c2e req-930a449b-ea1e-4692-a152-77a8f4ee93f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Apr 12 12:44:42 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 229/699] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:44:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-540928137", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "6bd5aca2-dc12-4f05-af95-523f7a183a5d"}], "security_groups": [{"name": "tempest-securitygroup--1251524765"}], "key_name": "tempest-keypair-1245622558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "3f8c0fb4-a50b-4195-ba6a-8e98f3360491", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:44 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] validate_networks() for [('6bd5aca2-dc12-4f05-af95-523f7a183a5d', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:44:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f8c0fb4-a50b-4195-ba6a-8e98f3360491',volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:44:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5a088911-54ed-43d2-a8f8-b7ab8aee855c tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.071844 Apr 12 12:44:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 236/700] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:44:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:44:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f8fe3d38-4505-40ce-892d-dc22f21b620b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:44:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f8fe3d38-4505-40ce-892d-dc22f21b620b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:44:45 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-f8fe3d38-4505-40ce-892d-dc22f21b620b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:44:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f8fe3d38-4505-40ce-892d-dc22f21b620b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1075 microversion: 2.1 time: 0.063715 Apr 12 12:44:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 236/701] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:44:45 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1075 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:44:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] Creating event network-changed:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:44:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-cfce8ea6-83f5-4535-9846-0e8b380dcf26 req-c363acde-f078-400a-a7db-800424d61063 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037094 Apr 12 12:44:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 230/702] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:44:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:44:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-00007461-3d5e-40a7-89b2-1cbbc779ab32 req-ea1dd13f-0c60-4e01-b60c-6f4207b0b5f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045469 Apr 12 12:44:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 237/703] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:44:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:44:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:44:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f87be7d4-622f-49a5-9db7-fa054830196d req-f80ac743-baea-4b6d-a31c-7e9b6b873c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039389 Apr 12 12:44:56 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 237/704] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 88e09fde-0a42-4066-b1f5-413903476735] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:45:03 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 HTTP/1.1 Apr 12 12:45:03 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:45:03 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:45:03 user devstack@n-api.service[61616]: Connection: close Apr 12 12:45:03 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:45:03 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:45:03 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:45:03 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:45:03 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:45:03 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:45:03 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:45:03 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:45:03 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:45:03 user devstack@n-api.service[61616]: method: > Apr 12 12:45:03 user devstack@n-api.service[61616]: exception: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. Apr 12 12:45:03 user devstack@n-api.service[61616]: action_args: {'id': '88e09fde-0a42-4066-b1f5-413903476735'} Apr 12 12:45:03 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. Apr 12 12:45:03 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:45:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 88e09fde-0a42-4066-b1f5-413903476735 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:45:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f16c1c45-2e35-4c29-828d-2f778e01b031 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735" status: 404 len: 111 microversion: 2.1 time: 0.142214 Apr 12 12:45:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 231/705] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:03 2023] GET /compute/v2.1/servers/88e09fde-0a42-4066-b1f5-413903476735 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: a4107f2d-88e4-4846-9ece-cb16ad7ecd02] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HTTP exception thrown: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Request method failure captured: Apr 12 12:45:06 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 HTTP/1.1 Apr 12 12:45:06 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:45:06 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:45:06 user devstack@n-api.service[61614]: Connection: close Apr 12 12:45:06 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:45:06 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:45:06 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:45:06 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:45:06 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPajtKreeen1BvBIukNq2K5bbAE4dQI4pcXQl4SrLk0qsljvifJsmSfn7qWZ3S9QTNAkC5zEscWQhQMgzZ0HKPefrSal9t_4fx76XBKSZMxu9qfg0YIRwx67buSlT1VmzOG-247FtoUg4U6aAHyZ03S78t-7XGs5SWONZ6wg-l1TLE Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Project-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Tenant-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:45:06 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:06 user devstack@n-api.service[61614]: X-User: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:45:06 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:45:06 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:45:06 user devstack@n-api.service[61614]: X-User-Id: 1db0203a6e6f4cc3bccbf19577a0c82f Apr 12 12:45:06 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:45:06 user devstack@n-api.service[61614]: method: > Apr 12 12:45:06 user devstack@n-api.service[61614]: exception: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. Apr 12 12:45:06 user devstack@n-api.service[61614]: action_args: {'id': 'a4107f2d-88e4-4846-9ece-cb16ad7ecd02'} Apr 12 12:45:06 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. Apr 12 12:45:06 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Returning 404 to user: Instance a4107f2d-88e4-4846-9ece-cb16ad7ecd02 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:45:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7ea8ffaf-c81a-450b-b405-9062f1daab38 tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02" status: 404 len: 111 microversion: 2.1 time: 0.141304 Apr 12 12:45:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 238/706] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:06 2023] GET /compute/v2.1/servers/a4107f2d-88e4-4846-9ece-cb16ad7ecd02 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:06 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:45:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a01be5ca-8b81-4855-bb9d-7044f3efa14e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 204 len: 0 microversion: 2.1 time: 0.123811 Apr 12 12:45:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 238/707] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:45:06 2023] DELETE /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:07 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db0203a6e6f4cc3bccbf19577a0c82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ec9671123c4a00a2880de4b4df8d3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fde0539c-6f6d-432b-9592-d9dabc8c426e tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 200 len: 1510 microversion: 2.1 time: 0.191648 Apr 12 12:45:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 232/708] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:06 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:45:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-unplugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] Creating event network-vif-unplugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:45:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a9ca0510-e38f-44d3-94a5-4c93545e9b30 req-734232a4-e267-42b2-b3b6-a26e5b14c387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117483 Apr 12 12:45:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 239/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-deleted", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] Creating event network-vif-deleted:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:45:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d90968f7-7e56-4cc6-bcac-755bef7a33c0 req-729294fd-771a-487f-bdf6-e03cc352d3bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Apr 12 12:45:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 239/710] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:09 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:45:09 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116da0-785c-41cf-96bb-95721af863db", "name": "network-vif-plugged", "status": "completed", "tag": "cbb69638-6a5f-4d12-8737-45850145fa0e"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:09 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e4ad0bfd-89e9-4f2d-b5ff-6c1cc62891ef tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 204 len: 0 microversion: 2.1 time: 0.130007 Apr 12 12:45:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 233/711] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:45:09 2023] DELETE /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:45:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] Creating event network-vif-plugged:cbb69638-6a5f-4d12-8737-45850145fa0e for instance 10116da0-785c-41cf-96bb-95721af863db on user Apr 12 12:45:09 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1f8c9da3-5b14-4412-9a85-31a190915f1b req-3704659c-81ed-40a4-930e-543829e00eac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Apr 12 12:45:09 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 240/712] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:09 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076e65b43f664765ad1d48be6e814f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ada441da2124adda751365952320e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8ae0192c-66b3-4614-a11a-308cda8b9edf tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 200 len: 1565 microversion: 2.1 time: 0.186720 Apr 12 12:45:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 240/713] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:09 2023] GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:45:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Creating event network-changed:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Creating event network-vif-unplugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-57631bd4-a91a-4158-83fe-65417d11ff0f req-59b8b8ca-fcbe-4e17-8482-2fe31ab63d45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.061430 Apr 12 12:45:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 234/714] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:12 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-plugged", "status": "completed", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}, {"server_uuid": "2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67", "name": "network-vif-deleted", "tag": "f6d914f7-c468-4bda-80d4-b6f37e3bea3c"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Creating event network-vif-unplugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Creating event network-vif-plugged:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] Creating event network-vif-deleted:f6d914f7-c468-4bda-80d4-b6f37e3bea3c for instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 on user Apr 12 12:45:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-ccfca374-8415-4942-abd6-8545fb72c10d req-12772a61-411c-446e-ba7e-e896ce2e1a79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033154 Apr 12 12:45:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 241/715] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:33 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:45:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-237aaf4f-f878-4b2c-8ea9-f2e5654c7ae2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e" status: 204 len: 0 microversion: 2.1 time: 0.119129 Apr 12 12:45:33 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 241/716] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:45:33 2023] DELETE /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:33 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-21080c3b-e40c-4dcc-9689-66d99dadc6d2 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e" status: 200 len: 1492 microversion: 2.1 time: 0.171274 Apr 12 12:45:33 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 235/717] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:33 2023] GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e => generated 1492 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "name": "network-vif-unplugged", "status": "completed", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:33 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] Creating event network-vif-unplugged:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:45:33 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-75c34f76-d692-4aa9-a26d-684ef8bc21e2 req-a1c8a272-903d-4cc6-847b-666fc58006e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045941 Apr 12 12:45:33 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 242/718] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "name": "network-vif-deleted", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] Creating event network-vif-deleted:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:45:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-dca1acad-5c28-434c-95bd-0280891cc38a req-463182c4-b697-4346-98b9-8b2f856ea1b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Apr 12 12:45:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 242/719] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:35 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0592fff-d30d-40dc-95d3-263aab10a70e", "name": "network-vif-plugged", "status": "completed", "tag": "92c07803-de20-43a3-98cc-f663ecf1c733"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:35 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:35 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] Creating event network-vif-plugged:92c07803-de20-43a3-98cc-f663ecf1c733 for instance d0592fff-d30d-40dc-95d3-263aab10a70e on user Apr 12 12:45:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-39fe292c-7807-4886-9e64-25c1c005a34f req-c28f32ce-5fc7-4c96-a7b2-5caf1524adf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Apr 12 12:45:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 236/720] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:36 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d30aad36-070e-477f-bca8-d0e571af9b78 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1429 microversion: 2.1 time: 0.153618 Apr 12 12:45:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 243/721] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:35 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1429 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3f376288-f085-4b1b-964f-6f788d6bfc37 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042932 Apr 12 12:45:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 243/722] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 12:45:39 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:40 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:45:40 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c24e0045-dc9f-4e38-a9fa-7ecf6ffcca8e tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 204 len: 0 microversion: 2.20 time: 0.157076 Apr 12 12:45:40 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 237/723] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:45:40 2023] DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e4935eed324b868477f8e88918364a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fec0c6dc7ab46b0b6b0a580252f40e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:45:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b4e12e7d-12d1-48db-b363-227cdb7c90e8 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 200 len: 1709 microversion: 2.20 time: 0.228617 Apr 12 12:45:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 244/724] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:45:40 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:45:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-unplugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] Creating event network-vif-unplugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:45:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-403fb490-5b76-42b2-b5a0-0305267f0603 req-3f313a6c-76e5-42e0-b2a6-d28366ae3c14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031201 Apr 12 12:45:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 244/725] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}, {"server_uuid": "08f95333-8c01-4fb1-a2cb-4501e6b0d2a5", "name": "network-vif-deleted", "tag": "7e54d3ba-dd94-4d8c-adca-16b108135e54"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:45:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Creating event network-vif-plugged:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:45:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] Creating event network-vif-deleted:7e54d3ba-dd94-4d8c-adca-16b108135e54 for instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 on user Apr 12 12:45:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-0bfe870e-0db4-4ac1-949e-25a5d1b6a309 req-8ee8fc44-aa1b-46a6-8a49-de1318c24b50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038865 Apr 12 12:45:42 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 238/726] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] [instance: 10116da0-785c-41cf-96bb-95721af863db] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=14 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] HTTP exception thrown: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Request method failure captured: Apr 12 12:45:57 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db HTTP/1.1 Apr 12 12:45:57 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:45:57 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:45:57 user devstack@n-api.service[61614]: Connection: close Apr 12 12:45:57 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:45:57 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:45:57 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:45:57 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:45:57 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPajtKreeen1BvBIukNq2K5bbAE4dQI4pcXQl4SrLk0qsljvifJsmSfn7qWZ3S9QTNAkC5zEscWQhQMgzZ0HKPefrSal9t_4fx76XBKSZMxu9qfg0YIRwx67buSlT1VmzOG-247FtoUg4U6aAHyZ03S78t-7XGs5SWONZ6wg-l1TLE Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Project-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9ec9671123c4a00a2880de4b4df8d3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Tenant-Id: f9ec9671123c4a00a2880de4b4df8d3e Apr 12 12:45:57 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1979263125 Apr 12 12:45:57 user devstack@n-api.service[61614]: X-User: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:45:57 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:45:57 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:45:57 user devstack@n-api.service[61614]: X-User-Id: 1db0203a6e6f4cc3bccbf19577a0c82f Apr 12 12:45:57 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1979263125-project-member Apr 12 12:45:57 user devstack@n-api.service[61614]: method: > Apr 12 12:45:57 user devstack@n-api.service[61614]: exception: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. Apr 12 12:45:57 user devstack@n-api.service[61614]: action_args: {'id': '10116da0-785c-41cf-96bb-95721af863db'} Apr 12 12:45:57 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. Apr 12 12:45:57 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:45:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] Returning 404 to user: Instance 10116da0-785c-41cf-96bb-95721af863db could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:45:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b89393ed-e77f-4727-8696-b5338befe48b tempest-ServerRescueNegativeTestJSON-1979263125 tempest-ServerRescueNegativeTestJSON-1979263125-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db" status: 404 len: 111 microversion: 2.1 time: 0.049401 Apr 12 12:45:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 245/727] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:57 2023] GET /compute/v2.1/servers/10116da0-785c-41cf-96bb-95721af863db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:45:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:45:59 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 HTTP/1.1 Apr 12 12:45:59 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:45:59 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:45:59 user devstack@n-api.service[61615]: Connection: close Apr 12 12:45:59 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:45:59 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:45:59 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:45:59 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:45:59 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:45:59 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:45:59 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:45:59 user devstack@n-api.service[61615]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:45:59 user devstack@n-api.service[61615]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:45:59 user devstack@n-api.service[61615]: method: > Apr 12 12:45:59 user devstack@n-api.service[61615]: exception: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. Apr 12 12:45:59 user devstack@n-api.service[61615]: action_args: {'id': '2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67'} Apr 12 12:45:59 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. Apr 12 12:45:59 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:45:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:45:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-16930aae-2835-4b95-bbc9-03218845b86b tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67" status: 404 len: 111 microversion: 2.1 time: 0.037186 Apr 12 12:45:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 245/728] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:45:59 2023] GET /compute/v2.1/servers/2d10c4fc-4cf8-4816-9dd0-f5b0f5c62f67 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:46:00 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 HTTP/1.1 Apr 12 12:46:00 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:46:00 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:46:00 user devstack@n-api.service[61616]: Connection: close Apr 12 12:46:00 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:46:00 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:46:00 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:46:00 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:46:00 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:46:00 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:46:00 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:46:00 user devstack@n-api.service[61616]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:46:00 user devstack@n-api.service[61616]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:46:00 user devstack@n-api.service[61616]: method: > Apr 12 12:46:00 user devstack@n-api.service[61616]: exception: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61616]: action_args: {'id': '68378ff4-9b1d-4fa5-9b83-8f6c27541c63'} Apr 12 12:46:00 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-42ae2079-d001-4b5c-9a8c-aa4057746e46 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 404 len: 111 microversion: 2.1 time: 0.047612 Apr 12 12:46:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 239/729] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:46:00 2023] DELETE /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] [instance: 68378ff4-9b1d-4fa5-9b83-8f6c27541c63] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] HTTP exception thrown: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Request method failure captured: Apr 12 12:46:00 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 HTTP/1.1 Apr 12 12:46:00 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:46:00 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:46:00 user devstack@n-api.service[61614]: Connection: close Apr 12 12:46:00 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:46:00 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:46:00 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:46:00 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:46:00 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqQERXrROD6aHiiRAZWmMI2xfLHci0_WP3vzuOPM0Kg-MAh6HhIeuTtmXcvzRMV4C3p1d913niw-cQaQ8wzY-T757TTJGDv7x98JeQ_W8s_Y3ViwYgX62Q1M6_5rU_vtQXxZq55E1lKJaXqcHZk3U8e65zGjb6CLRiofFowcOt1G-60 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Project-Id: 5ada441da2124adda751365952320e81 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Project-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ada441da2124adda751365952320e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ada441da2124adda751365952320e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Tenant: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Tenant-Id: 5ada441da2124adda751365952320e81 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TestVolumeBootPattern-310589135 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-User: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:46:00 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:46:00 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:46:00 user devstack@n-api.service[61614]: X-User-Id: 076e65b43f664765ad1d48be6e814f40 Apr 12 12:46:00 user devstack@n-api.service[61614]: X-User-Name: tempest-TestVolumeBootPattern-310589135-project-member Apr 12 12:46:00 user devstack@n-api.service[61614]: method: > Apr 12 12:46:00 user devstack@n-api.service[61614]: exception: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61614]: action_args: {'id': '68378ff4-9b1d-4fa5-9b83-8f6c27541c63'} Apr 12 12:46:00 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. Apr 12 12:46:00 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:46:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Returning 404 to user: Instance 68378ff4-9b1d-4fa5-9b83-8f6c27541c63 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b6874fa5-1056-4cb2-9f78-b86223071c9f tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63" status: 404 len: 111 microversion: 2.1 time: 0.034105 Apr 12 12:46:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 246/730] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:00 2023] GET /compute/v2.1/servers/68378ff4-9b1d-4fa5-9b83-8f6c27541c63 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:46:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-321982ca-b26d-46e6-b80a-cb9411e561e5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] Calling method '.version_select at 0x7fc95d24fd00>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-321982ca-b26d-46e6-b80a-cb9411e561e5 tempest-TestVolumeBootPattern-310589135 tempest-TestVolumeBootPattern-310589135-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1044387718" status: 202 len: 0 microversion: 2.1 time: 0.025128 Apr 12 12:46:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 246/731] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 12 12:46:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1044387718 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:46:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-387ab5f8-3933-4616-a2c6-ed01c436cf2e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: .version_select at 0x7fc95d2020e0>, body: {"keypair": {"name": "tempest-keypair-1664165816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdv55R/PFH7G3bAV+mLRNThOwZSl0ftMmxmYj5aU4BWLXfSGPog2OCXU22X8M1HmirOFjQTWnVswKvjPWgBWSuIO/2PPSCD+tkDfXlkxKDDKfnzAYyOJsq3Ofrf95xrQg=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:07 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-387ab5f8-3933-4616-a2c6-ed01c436cf2e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:07 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-387ab5f8-3933-4616-a2c6-ed01c436cf2e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:07 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-387ab5f8-3933-4616-a2c6-ed01c436cf2e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165806 Apr 12 12:46:07 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 240/732] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:46:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:09 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1943413206", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e211a286-ade0-4930-a327-4c6a41785094"}], "security_groups": [{"name": "tempest-securitygroup--1425896279"}], "key_name": "tempest-keypair-1664165816", "user_data": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:09 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] validate_networks() for [('e211a286-ade0-4930-a327-4c6a41785094', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:46:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:46:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7a1c64b1-f1d4-4084-8554-f6ac81219157 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.748150 Apr 12 12:46:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 247/733] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:46:09 2023] POST /compute/v2.1/servers => generated 400 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:46:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-237ac221-950a-4655-8167-0915522205da tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-237ac221-950a-4655-8167-0915522205da tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:10 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-237ac221-950a-4655-8167-0915522205da tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-237ac221-950a-4655-8167-0915522205da tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 200 len: 1236 microversion: 2.1 time: 0.071103 Apr 12 12:46:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 247/734] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:10 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:46:13 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] Creating event network-changed:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:46:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-1bba77ad-b428-48dc-8fd8-3d119fc1396c req-4ba9ad0b-d482-44bf-81c7-021bd0b5e2ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032299 Apr 12 12:46:13 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 241/735] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "name": "network-vif-plugged", "status": "completed", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] Creating event network-vif-plugged:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:46:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-5c2ca4f2-0cf8-4d47-96a8-442d0b94d19b req-b308148b-9338-4276-9830-af5414e7450f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061452 Apr 12 12:46:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:17 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "name": "network-vif-plugged", "status": "completed", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] Creating event network-vif-plugged:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:46:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-b3deeb74-4bfd-46c5-a655-70049500ad7b req-a31f72b5-6031-402b-97fd-1bc04f2d0148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030315 Apr 12 12:46:17 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 248/737] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: d0592fff-d30d-40dc-95d3-263aab10a70e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] HTTP exception thrown: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Request method failure captured: Apr 12 12:46:23 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e HTTP/1.1 Apr 12 12:46:23 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:46:23 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:46:23 user devstack@n-api.service[61616]: Connection: close Apr 12 12:46:23 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:46:23 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:46:23 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:46:23 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:46:23 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqd8Exj2BRqvXBi9U0O9vC1RrOkj8CDF9gxIVDL6HtxXCzypXkLnA1Bd2KSLo36i855zYqWNEX9YewaBGTAYBhksKfQubl_h8YD6iAI3Ho3Q5p1dbar3JvbMQOO1Zy2-nyTVlMnnwzFUrAdZeCErk_CV1CHPFuB2yqBdDKAMK3ceFNM Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Project-Id: bfd0006105e24edb9516d52c5af63054 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Project-Name: tempest-VolumesActionsTest-1646592366 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Tenant: tempest-VolumesActionsTest-1646592366 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Tenant-Id: bfd0006105e24edb9516d52c5af63054 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-VolumesActionsTest-1646592366 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-User: tempest-VolumesActionsTest-1646592366-project-member Apr 12 12:46:23 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:46:23 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:46:23 user devstack@n-api.service[61616]: X-User-Id: 2b3792e5a3b24583bbf50fb2b275b6d0 Apr 12 12:46:23 user devstack@n-api.service[61616]: X-User-Name: tempest-VolumesActionsTest-1646592366-project-member Apr 12 12:46:23 user devstack@n-api.service[61616]: method: > Apr 12 12:46:23 user devstack@n-api.service[61616]: exception: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. Apr 12 12:46:23 user devstack@n-api.service[61616]: action_args: {'id': 'd0592fff-d30d-40dc-95d3-263aab10a70e'} Apr 12 12:46:23 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. Apr 12 12:46:23 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Returning 404 to user: Instance d0592fff-d30d-40dc-95d3-263aab10a70e could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f46ec494-9aff-4136-9655-9bafe112f019 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e" status: 404 len: 111 microversion: 2.1 time: 0.053066 Apr 12 12:46:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 242/738] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:23 2023] GET /compute/v2.1/servers/d0592fff-d30d-40dc-95d3-263aab10a70e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-293731119", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "eaded3a8-c825-4731-95bc-3f39f32603da"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] validate_networks() for [('eaded3a8-c825-4731-95bc-3f39f32603da', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting quotas for project bfd0006105e24edb9516d52c5af63054. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Getting quotas for user 2b3792e5a3b24583bbf50fb2b275b6d0 and project bfd0006105e24edb9516d52c5af63054. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:46:24 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:46:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-05accbf9-d615-494b-ac3e-d988ec1d53a1 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.547708 Apr 12 12:46:24 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 249/739] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:46:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:46:24 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e3295031-423b-49c2-9df5-e86778b54962 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:24 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-e3295031-423b-49c2-9df5-e86778b54962 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:24 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-e3295031-423b-49c2-9df5-e86778b54962 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-e3295031-423b-49c2-9df5-e86778b54962 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea" status: 200 len: 1207 microversion: 2.1 time: 0.072410 Apr 12 12:46:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 249/740] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:24 2023] GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea => generated 1207 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:46:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e702924c-a079-4744-a112-985304a861ea", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] Creating event network-changed:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:46:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-33d00a8e-8017-4ab9-be0e-db823c2ad1f7 req-edd55dae-78e2-4080-8d9a-cd58fb710775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029733 Apr 12 12:46:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 243/741] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e702924c-a079-4744-a112-985304a861ea", "name": "network-vif-plugged", "status": "completed", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] Creating event network-vif-plugged:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:46:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-507c45c0-c332-4160-8558-20f5d34d1d71 req-8cb04ef0-63d4-4d95-8c68-6849ad9be38a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052544 Apr 12 12:46:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 250/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:46:30 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 HTTP/1.1 Apr 12 12:46:30 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:46:30 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:46:30 user devstack@n-api.service[61615]: Connection: close Apr 12 12:46:30 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:46:30 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:46:30 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:46:30 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:46:30 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:30 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:30 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:46:30 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:46:30 user devstack@n-api.service[61615]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:46:30 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:30 user devstack@n-api.service[61615]: method: > Apr 12 12:46:30 user devstack@n-api.service[61615]: exception: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:30 user devstack@n-api.service[61615]: action_args: {'id': '08f95333-8c01-4fb1-a2cb-4501e6b0d2a5'} Apr 12 12:46:30 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9f4a9e8f-8813-4c64-a9e4-233680eb2f6c tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 404 len: 111 microversion: 2.20 time: 0.038717 Apr 12 12:46:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 250/743] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:46:30 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:46:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-04f2516c-5471-4e66-97a1-c2baaeb4b7e4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '.version_select at 0x7fc95d26bd90>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-04f2516c-5471-4e66-97a1-c2baaeb4b7e4 tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116396079" status: 204 len: 0 microversion: 2.20 time: 0.023410 Apr 12 12:46:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 244/744] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 12:46:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116396079 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 12:46:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e702924c-a079-4744-a112-985304a861ea", "name": "network-vif-plugged", "status": "completed", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] Creating event network-vif-plugged:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:46:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-56680874-c310-4e20-9a07-97bd1dc11a69 req-2b804d08-7073-4a1d-8f5a-1f946f5436f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041158 Apr 12 12:46:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 251/745] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:46:34 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 HTTP/1.1 Apr 12 12:46:34 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:46:34 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:46:34 user devstack@n-api.service[61615]: Connection: close Apr 12 12:46:34 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:46:34 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:46:34 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:46:34 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:46:34 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:34 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:46:34 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:46:34 user devstack@n-api.service[61615]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:46:34 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:34 user devstack@n-api.service[61615]: method: > Apr 12 12:46:34 user devstack@n-api.service[61615]: exception: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61615]: action_args: {'id': '08f95333-8c01-4fb1-a2cb-4501e6b0d2a5'} Apr 12 12:46:34 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:34 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-540007a3-a43a-4847-91d2-720653dc72ea tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 404 len: 111 microversion: 2.20 time: 0.046303 Apr 12 12:46:34 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 251/746] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:46:34 2023] DELETE /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:46:34 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 HTTP/1.1 Apr 12 12:46:34 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:46:34 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:46:34 user devstack@n-api.service[61616]: Connection: close Apr 12 12:46:34 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:46:34 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:46:34 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:46:34 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:46:34 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:34 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:34 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:46:34 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:46:34 user devstack@n-api.service[61616]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:46:34 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:34 user devstack@n-api.service[61616]: method: > Apr 12 12:46:34 user devstack@n-api.service[61616]: exception: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61616]: action_args: {'id': '08f95333-8c01-4fb1-a2cb-4501e6b0d2a5'} Apr 12 12:46:34 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. Apr 12 12:46:34 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:34 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:34 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1e3abf8f-da4a-4e96-9fac-8c5467d76dfd tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5" status: 404 len: 111 microversion: 2.20 time: 0.030442 Apr 12 12:46:34 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 245/747] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:46:34 2023] GET /compute/v2.1/servers/08f95333-8c01-4fb1-a2cb-4501e6b0d2a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-03bb75c2-d9e8-4ba1-ae39-fb27aaa3714b tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.104685 Apr 12 12:46:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 252/748] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:46:36 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:46:36 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 HTTP/1.1 Apr 12 12:46:36 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:46:36 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:46:36 user devstack@n-api.service[61615]: Connection: close Apr 12 12:46:36 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:46:36 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:46:36 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:46:36 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:46:36 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:36 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:46:36 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:46:36 user devstack@n-api.service[61615]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:46:36 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:36 user devstack@n-api.service[61615]: method: > Apr 12 12:46:36 user devstack@n-api.service[61615]: exception: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61615]: action_args: {'id': '9439468d-7a45-443b-87ce-106907761a56'} Apr 12 12:46:36 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-206707bd-f689-4ad1-8220-42e3cc0585be tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 404 len: 111 microversion: 2.20 time: 0.036859 Apr 12 12:46:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 252/749] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 12:46:36 2023] DELETE /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] [instance: 9439468d-7a45-443b-87ce-106907761a56] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] HTTP exception thrown: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Request method failure captured: Apr 12 12:46:36 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 HTTP/1.1 Apr 12 12:46:36 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:46:36 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:46:36 user devstack@n-api.service[61616]: Connection: close Apr 12 12:46:36 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:46:36 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:46:36 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:46:36 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:46:36 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqTodyfbs87F_Mq3jDomYsqf-cbpd5MyhvznQ2MZlSa3fIgH3XHlWPN6Fai245PRaWeuGJn3u3_klKmdc4uij3BULN02iZ_IKe6LiOhh7we3goDKvLcknD09VAPmx-70_OGtC6TPRDv2dZxgMxtIn52sXyxKHu-w7PfPq9Cj3zPeZRw Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Project-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fec0c6dc7ab46b0b6b0a580252f40e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Tenant-Id: 5fec0c6dc7ab46b0b6b0a580252f40e3 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2036744628 Apr 12 12:46:36 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:36 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:46:36 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:46:36 user devstack@n-api.service[61616]: X-User-Id: 46e4935eed324b868477f8e88918364a Apr 12 12:46:36 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2036744628-project-member Apr 12 12:46:36 user devstack@n-api.service[61616]: method: > Apr 12 12:46:36 user devstack@n-api.service[61616]: exception: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61616]: action_args: {'id': '9439468d-7a45-443b-87ce-106907761a56'} Apr 12 12:46:36 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. Apr 12 12:46:36 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:46:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] Returning 404 to user: Instance 9439468d-7a45-443b-87ce-106907761a56 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:46:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-998bcae8-57a1-4052-98f5-3b972793346f tempest-AttachVolumeShelveTestJSON-2036744628 tempest-AttachVolumeShelveTestJSON-2036744628-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56" status: 404 len: 111 microversion: 2.20 time: 0.039844 Apr 12 12:46:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 246/750] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:46:36 2023] GET /compute/v2.1/servers/9439468d-7a45-443b-87ce-106907761a56 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:46:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] Creating event network-changed:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-61eb1ce4-56e9-411c-a984-f0a3d2126b82 req-2746602a-c8ff-467b-bd88-5883b7b2e2fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033369 Apr 12 12:46:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 253/751] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:37 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-284f99fd-8ab7-4e0d-adce-0874da34f945 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1429 microversion: 2.1 time: 0.279257 Apr 12 12:46:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 253/752] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:37 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1429 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:37 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Old instance type m1.nano, new instance type m1.micro {{(pid=61616) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for project 7ba5375005114c8594e0ae86b2f19093. Resources: {'ram', 'cores'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Getting quotas for user 29f7f46d32f4465ba3e8b504c645c22f and project 7ba5375005114c8594e0ae86b2f19093. Resources: {'ram', 'cores'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:46:38 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:46:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d6c49a54-f1cd-4056-81a6-50da5a7ab888 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action" status: 202 len: 0 microversion: 2.1 time: 0.534024 Apr 12 12:46:38 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 247/753] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:46:37 2023] POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:38 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-eca4d62b-c29b-4296-b576-ffdcad6e08b3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1438 microversion: 2.1 time: 0.315775 Apr 12 12:46:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 254/754] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:38 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1438 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:46:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] Creating event network-changed:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:46:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-4af0917c-10d8-40d8-88cc-cccad6cedb0d req-8d1aae32-5b54-47e8-aa85-0e9b8065dc00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043293 Apr 12 12:46:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 254/755] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:41 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:41 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Creating event network-vif-unplugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:46:41 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] Instance 62452efb-3a12-4aff-9359-217d17fc052a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:46:41 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e4caa6a4-9a81-4c0a-94d0-687c1ce80025 req-54c42cca-c516-472e-bb02-a328cee1588c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042423 Apr 12 12:46:41 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 248/756] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=23 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:46:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] Instance 62452efb-3a12-4aff-9359-217d17fc052a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:46:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-b9e6b6b6-381d-4079-9244-05a38fe9ecf7 req-f5934b5d-84e0-414f-bfca-4bfb919bc0b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097109 Apr 12 12:46:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 255/757] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=14 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4dcf63ac-cf8a-4740-9d3f-5223162c893e tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: .version_select at 0x7fc95d4b2b90>, body: {"keypair": {"name": "tempest-keypair-1238241126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuwf936taYEtQ87HL5K7RLSYNC7EYwzjJGVWMdDWY17MG7jKDK8n6UiYp0Wx2O8W7vbPN1WZy4g++M2EnVpaeEZHV1BaHycanzlOj8OAfSm/y0qUI9XhqdtXcmqo6mDGg=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:51 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-4dcf63ac-cf8a-4740-9d3f-5223162c893e tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:51 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-4dcf63ac-cf8a-4740-9d3f-5223162c893e tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for user 8a9c54033c7547c2bae91e6c1dba0976 and project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4dcf63ac-cf8a-4740-9d3f-5223162c893e tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.223457 Apr 12 12:46:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 255/758] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:46:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:46:52 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] Instance 62452efb-3a12-4aff-9359-217d17fc052a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:46:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-70df182f-6f9a-4a42-b13b-69cf29f31506 req-fc9595ef-d6b4-4f58-b8e8-830f20133f96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128544 Apr 12 12:46:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 249/759] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1788527008", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e1afe3b3-a919-4800-9f1c-c8e602defd4f"}], "security_groups": [{"name": "tempest-securitygroup--995004137"}], "key_name": "tempest-keypair-1238241126", "user_data": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=11 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] validate_networks() for [('e1afe3b3-a919-4800-9f1c-c8e602defd4f', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:46:53 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for user 8a9c54033c7547c2bae91e6c1dba0976 and project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:46:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:46:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3d917e47-fd53-46d6-b78a-20e398e85f52 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.577707 Apr 12 12:46:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 256/760] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:46:53 2023] POST /compute/v2.1/servers => generated 399 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:46:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-cefd6a61-6d92-45c5-a07b-e07deb8ba91f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:46:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-cefd6a61-6d92-45c5-a07b-e07deb8ba91f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:46:54 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-cefd6a61-6d92-45c5-a07b-e07deb8ba91f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:46:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-cefd6a61-6d92-45c5-a07b-e07deb8ba91f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1232 microversion: 2.1 time: 0.074879 Apr 12 12:46:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 256/761] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:46:54 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:46:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:46:54 user devstack@n-api.service[61616]: DEBUG nova.compute.api [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] Instance 62452efb-3a12-4aff-9359-217d17fc052a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61616) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 12:46:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-d5809e9e-b155-47ee-a14f-5103abf069e6 req-df7d544a-5175-4347-b523-fdbf2199ee1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041562 Apr 12 12:46:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 250/762] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] Creating event network-changed:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:46:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-efca2f51-3257-4290-bd20-18178aa6002d req-43076fd9-f2a6-4cf4-afdb-a4683670af54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037154 Apr 12 12:46:56 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 257/763] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:46:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:46:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:46:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:46:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:46:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:46:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-9fe9578c-e2a7-4c07-bc58-06e66aff3ca9 req-6ed8a23d-5c38-426c-bf6a-4c2b62bc26ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Apr 12 12:46:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 257/764] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:00 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:47:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9d648032-1c21-40c2-acd3-2f945358bcb7 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 200 len: 1546 microversion: 2.1 time: 0.142327 Apr 12 12:47:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 251/765] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:47:00 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:47:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:47:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:47:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-6782a4db-4714-4f69-8eb5-6a09d2ce471b req-02c96b6f-a857-4713-99c6-098e96842da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037750 Apr 12 12:47:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 258/766] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:47:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:14 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:47:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3eb9f809-eda2-407d-984e-f6c756ab522d tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea" status: 200 len: 1486 microversion: 2.1 time: 0.145782 Apr 12 12:47:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 258/767] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:47:14 2023] GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea => generated 1486 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=14 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:28 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:47:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e48f6fc4-9656-4e91-9059-5e3812d09ae9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1556 microversion: 2.1 time: 0.157662 Apr 12 12:47:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 252/768] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:47:28 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=9 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:47:44 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:47:44 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c24a9f19-7413-4855-a5f0-fcd761c2f0fc tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1537 microversion: 2.1 time: 0.174820 Apr 12 12:47:44 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 259/769] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:47:44 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c661336f-c51f-4451-b157-91261a6edfbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157727 Apr 12 12:48:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 259/770] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:48:00 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-interface => generated 282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] Creating event network-changed:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:48:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-68069c5e-8460-4dcb-b7c6-b8ef2722192e req-a62afb58-5b82-4c6e-96c1-e8cec516d441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035908 Apr 12 12:48:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 253/771] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0e8d0e28-c72b-4abb-80af-eb0ed0b8cd64 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/ips" status: 200 len: 108 microversion: 2.1 time: 0.040111 Apr 12 12:48:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 260/772] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:48:01 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "641c3b5e-f9ca-48ab-8b0c-cb013f333010"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-d9fd8306-67bf-4397-89ad-399798905e81 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259470 Apr 12 12:48:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 260/773] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:48:03 2023] POST /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9ea545b3-5641-4393-8f18-ffdf23dc7861 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: .version_select at 0x7fc95c137be0>, body: {"keypair": {"name": "tempest-keypair-465886863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKvgz8aLXkL1UKXgloE5a0NO7Dnov3h6aO83UrmYprW5fb0WDb7wXSnzJjb5RIqLorBqNq22tT9Q0H5PncM/xbLBZ+QGt4OD9dIDTA8doC20Ehow9LLFhPvQBMpGLeJjw=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:09 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-9ea545b3-5641-4393-8f18-ffdf23dc7861 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:48:09 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-9ea545b3-5641-4393-8f18-ffdf23dc7861 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:48:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9ea545b3-5641-4393-8f18-ffdf23dc7861 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046005 Apr 12 12:48:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 254/774] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:48:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1049944683", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e211a286-ade0-4930-a327-4c6a41785094"}], "security_groups": [{"name": "tempest-securitygroup--1404733498"}], "key_name": "tempest-keypair-465886863", "user_data": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:11 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] validate_networks() for [('e211a286-ade0-4930-a327-4c6a41785094', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:48:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:48:12 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:48:12 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e3f696d4-6882-4df5-967a-9c4a67769726 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.809596 Apr 12 12:48:12 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 261/775] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:48:11 2023] POST /compute/v2.1/servers => generated 400 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:48:12 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8eae9b29-1730-4746-8a27-4719c56ad3b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:12 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8eae9b29-1730-4746-8a27-4719c56ad3b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:12 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-8eae9b29-1730-4746-8a27-4719c56ad3b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:48:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8eae9b29-1730-4746-8a27-4719c56ad3b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 200 len: 1235 microversion: 2.1 time: 0.063928 Apr 12 12:48:12 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 261/776] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:48:12 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] Creating event network-changed:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:48:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-92533b49-d874-401d-930f-7147192f443f req-11648d87-fc21-46f9-bc39-54f6e65c8433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032345 Apr 12 12:48:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 255/777] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:48:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-46299ded-26b9-4487-b81d-5111b8da5870 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea" status: 204 len: 0 microversion: 2.1 time: 0.123433 Apr 12 12:48:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 262/778] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:48:15 2023] DELETE /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3792e5a3b24583bbf50fb2b275b6d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd0006105e24edb9516d52c5af63054', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:48:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fab95de6-7d15-481c-aebe-c2f5275e628f tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea" status: 200 len: 1492 microversion: 2.1 time: 0.207326 Apr 12 12:48:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 262/779] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:48:15 2023] GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea => generated 1492 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e702924c-a079-4744-a112-985304a861ea", "name": "network-vif-unplugged", "status": "completed", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] Creating event network-vif-unplugged:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:48:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-48474e09-fedb-44d0-9ac8-5498e1ed4461 req-93e76c63-e0b0-4da7-99b0-6a73eb0fc7a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069942 Apr 12 12:48:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 256/780] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e702924c-a079-4744-a112-985304a861ea", "name": "network-vif-deleted", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] Creating event network-vif-deleted:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:48:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c9184559-af2d-470d-a5d8-2d451e4795c9 req-f21691ee-ad50-41f7-8f25-fcdd51cfca1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049245 Apr 12 12:48:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 263/781] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:17 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e702924c-a079-4744-a112-985304a861ea", "name": "network-vif-plugged", "status": "completed", "tag": "ec18f93d-7e1c-4140-bd72-4945caafc3b0"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] Creating event network-vif-plugged:ec18f93d-7e1c-4140-bd72-4945caafc3b0 for instance e702924c-a079-4744-a112-985304a861ea on user Apr 12 12:48:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-1abdc3a2-277d-4968-ba01-28620cb1f39c req-b8e7dcd7-dddd-4c47-91c5-6059a62d2288 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028416 Apr 12 12:48:17 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 263/782] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "name": "network-vif-plugged", "status": "completed", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}, {"server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "name": "network-vif-plugged", "status": "completed", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Creating event network-vif-plugged:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:48:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] Creating event network-vif-plugged:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:48:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-94661ab7-f9ac-40bf-a690-92c1bacbc7a5 req-04fc6e51-ae0c-4d45-a33c-96853d18d994 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047308 Apr 12 12:48:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 257/783] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-981619ed-5d01-413d-b356-e4f0611161c0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action" status: 204 len: 0 microversion: 2.1 time: 0.081158 Apr 12 12:48:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 264/784] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:48:28 2023] POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:28 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:29 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:48:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4ae8913a-4973-4aa5-97f7-bfebcd3b5f5f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1556 microversion: 2.1 time: 0.171096 Apr 12 12:48:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 264/785] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:48:28 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:44 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:44 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-770aea0f-d257-4aa1-8f53-09eccf6300af tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157767 Apr 12 12:48:44 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 258/786] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:48:44 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-interface => generated 282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] Creating event network-changed:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:48:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f0843858-9d6c-48be-8e7d-17f773f7ac4a req-ca81bef0-6380-420b-88b8-c6fe827f9ee4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035544 Apr 12 12:48:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 265/787] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-206d3dd7-8504-400c-a96d-97ebb0d747e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/ips" status: 200 len: 144 microversion: 2.1 time: 0.042421 Apr 12 12:48:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 265/788] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:48:46 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02c22408-e0c3-41e4-817c-dc6057451b06"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ddb30a83-1f95-43ee-baa6-8da69b645fe1 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299683 Apr 12 12:48:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 259/789] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:48:48 2023] POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:55 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Going to try to stop instance {{(pid=61614) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 12:48:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2085affa-aac6-4523-91c7-9b1727d36236 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action" status: 202 len: 0 microversion: 2.1 time: 0.388743 Apr 12 12:48:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 266/790] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:48:54 2023] POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:55 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:48:55 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-12ffad0b-46ee-4024-8565-42453317b8e7 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1712 microversion: 2.1 time: 0.234253 Apr 12 12:48:55 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 266/791] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:48:55 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1712 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:48:55 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-unplugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] Creating event network-vif-unplugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:48:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-97001906-89e1-48a7-a62b-c2d87613e171 req-d5d1b264-f717-4041-8495-8d72997a38c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029611 Apr 12 12:48:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 260/792] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:48:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:48:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:48:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:48:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:48:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:48:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-ab20b1a4-46ee-4895-9820-0da41cd81c09 req-3e72bffe-6019-488d-a81d-1e6ea46690fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Apr 12 12:48:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 267/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:02 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:49:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-83bebe1e-794b-407e-a00f-a26e287307d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 200 len: 1545 microversion: 2.1 time: 0.151914 Apr 12 12:49:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 267/794] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:49:02 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] [instance: e702924c-a079-4744-a112-985304a861ea] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] HTTP exception thrown: Instance e702924c-a079-4744-a112-985304a861ea could not be found. Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Request method failure captured: Apr 12 12:49:05 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea HTTP/1.1 Apr 12 12:49:05 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:49:05 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:49:05 user devstack@n-api.service[61616]: Connection: close Apr 12 12:49:05 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:49:05 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:49:05 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:49:05 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:49:05 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqd8Exj2BRqvXBi9U0O9vC1RrOkj8CDF9gxIVDL6HtxXCzypXkLnA1Bd2KSLo36i855zYqWNEX9YewaBGTAYBhksKfQubl_h8YD6iAI3Ho3Q5p1dbar3JvbMQOO1Zy2-nyTVlMnnwzFUrAdZeCErk_CV1CHPFuB2yqBdDKAMK3ceFNM Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Project-Id: bfd0006105e24edb9516d52c5af63054 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Project-Name: tempest-VolumesActionsTest-1646592366 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfd0006105e24edb9516d52c5af63054"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Tenant: tempest-VolumesActionsTest-1646592366 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Tenant-Id: bfd0006105e24edb9516d52c5af63054 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-VolumesActionsTest-1646592366 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-User: tempest-VolumesActionsTest-1646592366-project-member Apr 12 12:49:05 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:49:05 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:49:05 user devstack@n-api.service[61616]: X-User-Id: 2b3792e5a3b24583bbf50fb2b275b6d0 Apr 12 12:49:05 user devstack@n-api.service[61616]: X-User-Name: tempest-VolumesActionsTest-1646592366-project-member Apr 12 12:49:05 user devstack@n-api.service[61616]: method: > Apr 12 12:49:05 user devstack@n-api.service[61616]: exception: Instance e702924c-a079-4744-a112-985304a861ea could not be found. Apr 12 12:49:05 user devstack@n-api.service[61616]: action_args: {'id': 'e702924c-a079-4744-a112-985304a861ea'} Apr 12 12:49:05 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e702924c-a079-4744-a112-985304a861ea could not be found. Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e702924c-a079-4744-a112-985304a861ea could not be found. Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e702924c-a079-4744-a112-985304a861ea could not be found. Apr 12 12:49:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:49:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] Returning 404 to user: Instance e702924c-a079-4744-a112-985304a861ea could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:49:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-dcc44a12-60fd-4cf4-92f3-7c7842d38900 tempest-VolumesActionsTest-1646592366 tempest-VolumesActionsTest-1646592366-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea" status: 404 len: 111 microversion: 2.1 time: 0.146693 Apr 12 12:49:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 261/795] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:49:05 2023] GET /compute/v2.1/servers/e702924c-a079-4744-a112-985304a861ea => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:49:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-06eed952-448c-47e2-836a-cb5c13f12fb1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1548 microversion: 2.1 time: 0.311698 Apr 12 12:49:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 268/796] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:49:19 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1548 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=16 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:45 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:49:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-91688f56-6201-4660-9b8b-9b4f7289bba0 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1689 microversion: 2.1 time: 0.218291 Apr 12 12:49:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 268/797] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:49:45 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:49:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-85e8c37f-f01e-46aa-8fa1-7e1dfefc147b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: .version_select at 0x7fc95c136170>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1590711499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzeWBX6IhC7gCQ6w0T3CIjF58xU+K7xE+03Z94BwQAzy1OeRNbL96UH1iSrsClMKm4rn8M5qup/LJ+NKAIWGUUK2r0ARV/KqOHOttU7oRuA6Ty3XfX6ezVU/ChdOvsk/g=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:49:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:52 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-85e8c37f-f01e-46aa-8fa1-7e1dfefc147b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:49:52 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-85e8c37f-f01e-46aa-8fa1-7e1dfefc147b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for user 924c3a968d734a1c9ddfc5a44d8f6352 and project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:49:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-85e8c37f-f01e-46aa-8fa1-7e1dfefc147b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059243 Apr 12 12:49:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 262/798] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:49:52 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1462256376", "imageRef": "71858585-d70e-4cf1-b2dc-0e5921c23e98", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1590711499", "networks": [{"uuid": "76f8fc2b-41cf-4efd-9820-c4d4056deaca"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] validate_networks() for [('76f8fc2b-41cf-4efd-9820-c4d4056deaca', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for user 924c3a968d734a1c9ddfc5a44d8f6352 and project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:49:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71858585-d70e-4cf1-b2dc-0e5921c23e98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:49:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-9eb3d3c0-2440-4b90-b686-7d873dfa030a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.539914 Apr 12 12:49:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 269/799] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:49:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:49:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4758d209-f45e-4763-97f2-e8dcccc75c45 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:49:52 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4758d209-f45e-4763-97f2-e8dcccc75c45 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:49:52 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-4758d209-f45e-4763-97f2-e8dcccc75c45 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:49:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4758d209-f45e-4763-97f2-e8dcccc75c45 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1253 microversion: 2.1 time: 0.078172 Apr 12 12:49:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 269/800] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:49:52 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1253 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:49:55 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508746c9-705a-4d77-a528-454a10299411", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:49:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] Creating event network-changed:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:49:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-eb62d836-7fd2-4455-af4f-24db5671bd17 req-1e5ba205-1862-4bb8-a00b-fd3e34aaae86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494927 Apr 12 12:49:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 263/801] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:49:57 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:49:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:57 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:49:57 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-af6ed0d6-9a81-43c0-bbd6-531675a591dd req-5a2f5966-2b3f-4740-8306-49aca5428b2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044629 Apr 12 12:49:57 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 270/802] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:49:59 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:49:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:49:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:49:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:49:59 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:49:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:49:59 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a5c73f44-bcca-4b46-b070-b86bb51a0e91 req-3cde691d-f916-453e-aa8d-44c23dc0295b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Apr 12 12:49:59 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 270/803] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:49:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:02 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:02 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e28bbf89-b550-4d6f-8106-3ec46f850376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091562 Apr 12 12:50:02 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 264/804] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:50:02 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] Creating event network-changed:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:50:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1e76382f-919e-4681-bcf7-19e7cef0664a req-131311cf-34b2-4b85-a75c-c80519573859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 Apr 12 12:50:03 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 271/805] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f953faa2-7f0c-4f2a-b453-dd66bcea03bc tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/ips" status: 200 len: 108 microversion: 2.1 time: 0.040563 Apr 12 12:50:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 271/806] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:50:03 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "641c3b5e-f9ca-48ab-8b0c-cb013f333010"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 12:50:04 user devstack@n-api.service[61616]: request: POST /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/os-volume_attachments HTTP/1.1 Apr 12 12:50:04 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:50:04 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:50:04 user devstack@n-api.service[61616]: Connection: close Apr 12 12:50:04 user devstack@n-api.service[61616]: Content-Length: 74 Apr 12 12:50:04 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:50:04 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:50:04 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:50:04 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:50:04 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:50:04 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:50:04 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 12:50:04 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:50:04 user devstack@n-api.service[61616]: Apr 12 12:50:04 user devstack@n-api.service[61616]: {"volumeAttachment": {"volumeId": "641c3b5e-f9ca-48ab-8b0c-cb013f333010"}} Apr 12 12:50:04 user devstack@n-api.service[61616]: method: > Apr 12 12:50:04 user devstack@n-api.service[61616]: exception: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 Apr 12 12:50:04 user devstack@n-api.service[61616]: action_args: {'server_id': 'c11aafa6-a6fa-44f2-8357-23d838a0b65a', 'body': {'volumeAttachment': {'volumeId': '641c3b5e-f9ca-48ab-8b0c-cb013f333010'}}} Apr 12 12:50:04 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 Apr 12 12:50:04 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 400 to user: Invalid volume: volume 641c3b5e-f9ca-48ab-8b0c-cb013f333010 is already attached to instances: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:50:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-29bbcd57-62ae-4320-906d-bc4392763778 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108761 Apr 12 12:50:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 265/807] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:50:04 2023] POST /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:50:04 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-f2092732-fa46-4c7d-9a31-6687ba61aa76 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 204 len: 0 microversion: 2.1 time: 0.138884 Apr 12 12:50:04 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 272/808] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:50:04 2023] DELETE /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:04 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:50:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5005ef74-44f5-40e8-8c01-07f23d911852 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 200 len: 1551 microversion: 2.1 time: 0.183879 Apr 12 12:50:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 272/809] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:04 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 1551 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:50:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}, {"server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "name": "network-vif-plugged", "status": "completed", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}, {"server_uuid": "c11aafa6-a6fa-44f2-8357-23d838a0b65a", "name": "network-vif-deleted", "tag": "d5393827-131c-4d5f-8135-1cfab67f5779"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Creating event network-vif-unplugged:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:50:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Creating event network-vif-plugged:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:50:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] Creating event network-vif-deleted:d5393827-131c-4d5f-8135-1cfab67f5779 for instance c11aafa6-a6fa-44f2-8357-23d838a0b65a on user Apr 12 12:50:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-ffeef03a-254a-4f4b-bfcf-21b589f57159 req-a070b2db-3ed8-4a7a-99d4-136e18655edf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035532 Apr 12 12:50:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 266/810] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:50:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6534c69d-3851-4742-afcd-bbdc6d72ff08 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1548 microversion: 2.1 time: 0.392310 Apr 12 12:50:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 273/811] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:19 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1548 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-43b4ff65-c4b9-4dc9-9a86-c23086d817e0 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action" status: 200 len: 28493 microversion: 2.1 time: 0.234524 Apr 12 12:50:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 273/812] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:50:19 2023] POST /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a/action => generated 28493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=14 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:50:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-270fe690-aad1-4bc0-90d1-e99cfe6bffdb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 200 len: 1541 microversion: 2.1 time: 0.159685 Apr 12 12:50:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 267/813] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:20 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 1541 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:50:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-101dce3c-1a88-4f7c-89e3-af333a108251 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1538 microversion: 2.1 time: 0.173718 Apr 12 12:50:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 274/814] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:42 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1538 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Going to try to start instance {{(pid=61615) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 12:50:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-bb1085de-580c-4953-a705-772c46c8a797 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action" status: 202 len: 0 microversion: 2.1 time: 0.113523 Apr 12 12:50:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 274/815] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:50:45 2023] POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:46 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:50:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-36e939b2-b90a-46ff-a675-0b74ae430e91 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1698 microversion: 2.1 time: 0.303505 Apr 12 12:50:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 268/816] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:46 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1698 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:50:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:50:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-cab8b341-af02-4f3b-9fcd-51bf0d356280 req-a3f9970d-e58b-435b-bbd1-5ef09131de95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092061 Apr 12 12:50:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 275/817] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:50:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:50:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:50:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-cbd6dfd4-8651-4600-a597-0c68f8b2a55a req-416bf3b1-2e77-46cf-a39b-6d9a834aa5be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028220 Apr 12 12:50:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 275/818] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 12:50:54 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a HTTP/1.1 Apr 12 12:50:54 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:50:54 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:50:54 user devstack@n-api.service[61616]: Connection: close Apr 12 12:50:54 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:50:54 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:50:54 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:50:54 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:50:54 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:50:54 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:50:54 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:50:54 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 12:50:54 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:50:54 user devstack@n-api.service[61616]: method: > Apr 12 12:50:54 user devstack@n-api.service[61616]: exception: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 12:50:54 user devstack@n-api.service[61616]: action_args: {'id': 'c11aafa6-a6fa-44f2-8357-23d838a0b65a'} Apr 12 12:50:54 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 12:50:54 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:50:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:50:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fb0e2091-f5e5-462f-9e59-bd6963188b9f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 404 len: 111 microversion: 2.1 time: 0.041129 Apr 12 12:50:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 269/819] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:50:54 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:50:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-48f0a70a-d400-4c32-8113-da483518e70f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '.version_select at 0x7fc95d1d5120>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-48f0a70a-d400-4c32-8113-da483518e70f tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465886863" status: 202 len: 0 microversion: 2.1 time: 0.031879 Apr 12 12:50:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 276/820] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 12:50:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465886863 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:55 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'services' on Instance uuid 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:50:55 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-e875ef12-58aa-4ef1-8909-adc66b08abd3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments/641c3b5e-f9ca-48ab-8b0c-cb013f333010" status: 202 len: 0 microversion: 2.1 time: 0.211486 Apr 12 12:50:55 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 276/821] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:50:55 2023] DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments/641c3b5e-f9ca-48ab-8b0c-cb013f333010 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:50:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:50:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2d7def4c-3bd8-4812-8292-6f1cf666e479 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058488 Apr 12 12:50:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 270/822] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:50:55 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:20 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:51:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b258cd0a-fd66-438c-9a77-08326cbb102d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 204 len: 0 microversion: 2.1 time: 0.117916 Apr 12 12:51:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 277/823] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:51:20 2023] DELETE /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:20 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f4ed82d2-2a32-4f75-8ada-0e5891a4c0b1 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 200 len: 1554 microversion: 2.1 time: 0.186614 Apr 12 12:51:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 277/824] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:20 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=14 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-unplugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] Creating event network-vif-unplugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:51:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-ef4c6847-e7c6-4e84-a9a0-5039e82c8747 req-a1de3604-d9a0-4342-a144-f3a8456ecaef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038158 Apr 12 12:51:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 271/825] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:22 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-deleted", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:22 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] Creating event network-vif-deleted:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:51:22 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-6aab51d9-9fcd-4c35-8d07-6cfeae9c4628 req-9963d285-1770-4e85-a5a6-f83a489f55b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032297 Apr 12 12:51:22 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 278/826] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62452efb-3a12-4aff-9359-217d17fc052a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea59aa7-b979-4fa0-b26b-cf96ad5addb2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] Creating event network-vif-plugged:6ea59aa7-b979-4fa0-b26b-cf96ad5addb2 for instance 62452efb-3a12-4aff-9359-217d17fc052a on user Apr 12 12:51:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-02d7bbc3-44e7-424f-8878-b418d67be22b req-89ec0a00-a066-4aa0-9d71-42af87cb8149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028779 Apr 12 12:51:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 278/827] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:36 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-96503b06-725c-4379-92c4-653992d79558 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1702 microversion: 2.1 time: 0.174793 Apr 12 12:51:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 272/828] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:36 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1702 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-36ade236-21b2-4a7f-9d62-909bb457882c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1538 microversion: 2.1 time: 0.169120 Apr 12 12:51:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 279/829] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:43 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1538 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Searching by: {'deleted': False, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472'} {{(pid=61615) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61615]: DEBUG nova.compute.multi_cell_list [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 12:51:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5b609e41-1c44-4a55-adff-4cfbb9a94fde tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.193125 Apr 12 12:51:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 279/830] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 12:51:43 2023] GET /compute/v2.1/servers => generated 341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:43 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1851bb2a-0c54-486f-8f09-f4d502836dc9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1538 microversion: 2.1 time: 0.182877 Apr 12 12:51:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 273/831] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:43 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1538 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3675f4a6-a994-41d9-9477-08b2f072dae0"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9fd26ff9-3b05-4c90-a25b-af36dcb33bcd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149271 Apr 12 12:51:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 280/832] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:51:45 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:51:45 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-565947f5-885c-4751-a3c8-4bc691a5ff4b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335612 Apr 12 12:51:45 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 280/833] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:51:45 2023] POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:45 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:51:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-13eff7a6-ca4a-416f-a715-3426e4ca7d26 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 204 len: 0 microversion: 2.1 time: 0.130788 Apr 12 12:51:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 274/834] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:51:45 2023] DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:46 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-75773979-60ea-46fb-8a85-9b4976559b32 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 200 len: 1670 microversion: 2.1 time: 0.160152 Apr 12 12:51:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 281/835] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:46 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "name": "network-vif-unplugged", "status": "completed", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] Creating event network-vif-unplugged:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:51:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-81d25a02-4f1e-454e-ac03-b7c2294785b6 req-52d297ae-4480-40ec-a5b8-19f9ece8b890 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038578 Apr 12 12:51:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 281/836] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "name": "network-vif-plugged", "status": "completed", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}, {"server_uuid": "9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9", "name": "network-vif-deleted", "tag": "968b45e2-1ead-4fdd-a879-52ebb15f5b6a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Creating event network-vif-plugged:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:51:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] Creating event network-vif-deleted:968b45e2-1ead-4fdd-a879-52ebb15f5b6a for instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 on user Apr 12 12:51:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-5ae9fc76-74b1-4555-a761-c2ee799e8378 req-621a58cf-ff90-43c8-9f78-f6934c230839 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032385 Apr 12 12:51:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 275/837] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:54 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4fe0af5d-20ad-4ff9-85c7-4233081f74fd tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1584 microversion: 2.1 time: 0.153445 Apr 12 12:51:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 282/838] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:54 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1584 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508746c9-705a-4d77-a528-454a10299411", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] Creating event network-changed:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:51:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a75cc059-c27b-48ac-b60e-1f312c1fb42b req-82a0a133-4309-4831-b88b-391fdaf8c9b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100124 Apr 12 12:51:56 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 282/839] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2094617542"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:57 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:58 user devstack@n-api.service[61616]: INFO nova.network.security_group_api [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Adding security group e90cc693-a8a5-46ea-8940-f1b877d09154 to port dab72490-cdfa-4ffa-be0b-feda75d66bcb Apr 12 12:51:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-490e3904-30fe-46cc-a83d-d9736e9acae5 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action" status: 202 len: 0 microversion: 2.1 time: 0.617945 Apr 12 12:51:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 276/840] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:51:57 2023] POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:51:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508746c9-705a-4d77-a528-454a10299411", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:51:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:51:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] Creating event network-changed:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:51:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-11117e7b-5da3-491d-bb4f-84e997bee999 req-50729f0e-651e-4c4c-bea3-cabc988983fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 Apr 12 12:51:58 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 283/841] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:51:58 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:51:58 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8a63b02c-50f7-444c-9c63-440093a65b13 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1749 microversion: 2.1 time: 0.180691 Apr 12 12:51:58 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 283/842] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:51:58 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c79ed823-edda-4532-aedf-c650fec84aa4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action" status: 202 len: 0 microversion: 2.1 time: 0.092297 Apr 12 12:52:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 277/843] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:52:01 2023] POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:01 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:52:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3d2b8bcb-08f5-49b4-ab9c-3679148a6161 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1751 microversion: 2.1 time: 0.164530 Apr 12 12:52:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 284/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:01 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:52:02 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-unplugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:02 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] Creating event network-vif-unplugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:02 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-545610c4-0376-409b-9eca-af57ebe14b24 req-11f52f73-16b8-4b3e-8674-78ece57bf4f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035630 Apr 12 12:52:02 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 284/845] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}, {"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}, {"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}, {"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-unplugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}, {"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Creating event network-vif-unplugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-255edddc-5462-448f-9685-87b6902b0231 req-0512e40c-d14e-4ba7-87dd-738a055ee170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033960 Apr 12 12:52:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 278/846] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-edff903e-cd9c-4d64-936c-1fcad998c71c req-ece1acc8-0722-4e2f-a007-e70ac8b9ade9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Apr 12 12:52:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 285/847] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:08 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:08 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:08 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:52:08 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-07d6cd83-effb-4fb1-8481-f8771ecddbba req-2b9b73f1-cbb0-46a6-a8ae-ceb391ece3b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047810 Apr 12 12:52:08 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 285/848] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:52:10 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a HTTP/1.1 Apr 12 12:52:10 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:52:10 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:52:10 user devstack@n-api.service[61616]: Connection: close Apr 12 12:52:10 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:52:10 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:52:10 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:52:10 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:52:10 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61616]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:10 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:52:10 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:52:10 user devstack@n-api.service[61616]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:52:10 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:10 user devstack@n-api.service[61616]: method: > Apr 12 12:52:10 user devstack@n-api.service[61616]: exception: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61616]: action_args: {'id': '62452efb-3a12-4aff-9359-217d17fc052a'} Apr 12 12:52:10 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:52:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-93196ead-a55b-4769-b81b-0e87c82f0182 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 404 len: 111 microversion: 2.1 time: 0.038884 Apr 12 12:52:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 279/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:10 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:52:10 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a HTTP/1.1 Apr 12 12:52:10 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:52:10 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:52:10 user devstack@n-api.service[61615]: Connection: close Apr 12 12:52:10 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:52:10 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:52:10 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:52:10 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:52:10 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:10 user devstack@n-api.service[61615]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:10 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:52:10 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:52:10 user devstack@n-api.service[61615]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:52:10 user devstack@n-api.service[61615]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:10 user devstack@n-api.service[61615]: method: > Apr 12 12:52:10 user devstack@n-api.service[61615]: exception: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61615]: action_args: {'id': '62452efb-3a12-4aff-9359-217d17fc052a'} Apr 12 12:52:10 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:10 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:52:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ca8f6465-0413-4138-a47c-13ff627b0c25 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 404 len: 111 microversion: 2.1 time: 0.033398 Apr 12 12:52:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 286/850] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:52:10 2023] DELETE /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:52:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 62452efb-3a12-4aff-9359-217d17fc052a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:52:11 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a HTTP/1.1 Apr 12 12:52:11 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:52:11 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:52:11 user devstack@n-api.service[61614]: Connection: close Apr 12 12:52:11 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:52:11 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:52:11 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:52:11 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:52:11 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:52:11 user devstack@n-api.service[61614]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:11 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:52:11 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:52:11 user devstack@n-api.service[61614]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:52:11 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:52:11 user devstack@n-api.service[61614]: method: > Apr 12 12:52:11 user devstack@n-api.service[61614]: exception: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:11 user devstack@n-api.service[61614]: action_args: {'id': '62452efb-3a12-4aff-9359-217d17fc052a'} Apr 12 12:52:11 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. Apr 12 12:52:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 62452efb-3a12-4aff-9359-217d17fc052a could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:52:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-bcaf60bb-4d97-458b-8761-dc38d8400d3d tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a" status: 404 len: 111 microversion: 2.1 time: 0.072731 Apr 12 12:52:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 286/851] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:10 2023] GET /compute/v2.1/servers/62452efb-3a12-4aff-9359-217d17fc052a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:52:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7d3491c9-cfb1-4b7a-89e6-a34b8e414a0e tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 204 len: 0 microversion: 2.1 time: 0.120580 Apr 12 12:52:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 280/852] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:52:11 2023] DELETE /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f7f46d32f4465ba3e8b504c645c22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba5375005114c8594e0ae86b2f19093', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:52:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9b2ee267-6442-4824-b760-1091faec00d9 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 200 len: 1547 microversion: 2.1 time: 0.175943 Apr 12 12:52:11 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 287/853] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:11 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 1547 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "name": "network-vif-unplugged", "status": "completed", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] Creating event network-vif-unplugged:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:52:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-90442222-d8fa-4747-9c10-7a18045457fd req-04ca3548-6a0d-4b99-901e-952c58d982ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034790 Apr 12 12:52:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 287/854] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "name": "network-vif-plugged", "status": "completed", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}, {"server_uuid": "a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7", "name": "network-vif-deleted", "tag": "01ee163a-4590-4b09-bcb5-a53d238252d8"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Creating event network-vif-plugged:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:52:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] Creating event network-vif-deleted:01ee163a-4590-4b09-bcb5-a53d238252d8 for instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 on user Apr 12 12:52:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e7ac8816-9615-415e-96b6-4e2afc7a56bf req-8c78d853-bcd3-4cbb-a970-9e3084d10050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034371 Apr 12 12:52:13 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 281/855] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=18 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=44 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 12:52:36 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 HTTP/1.1 Apr 12 12:52:36 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:52:36 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:52:36 user devstack@n-api.service[61615]: Connection: close Apr 12 12:52:36 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:52:36 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:52:36 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:52:36 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:52:36 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:52:36 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:52:36 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:52:36 user devstack@n-api.service[61615]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 12:52:36 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:52:36 user devstack@n-api.service[61615]: method: > Apr 12 12:52:36 user devstack@n-api.service[61615]: exception: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 12:52:36 user devstack@n-api.service[61615]: action_args: {'id': '9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9'} Apr 12 12:52:36 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 12:52:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:52:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:52:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-28e69c54-ed4c-4992-8ed2-9f4ef4a22d3c tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 404 len: 111 microversion: 2.1 time: 0.033999 Apr 12 12:52:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 288/856] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:36 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:52:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=16 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-aef49413-046a-4cd1-beea-2e40d93b662e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '.version_select at 0x7fc95d7f2c20>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-aef49413-046a-4cd1-beea-2e40d93b662e tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664165816" status: 202 len: 0 microversion: 2.1 time: 0.036518 Apr 12 12:52:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 288/857] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:52:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664165816 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:37 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'services' on Instance uuid db9f1454-9e3c-40d4-849b-c13537d6be97 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:52:37 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d2994507-1537-4278-a3df-826a42960c10 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments/02c22408-e0c3-41e4-817c-dc6057451b06" status: 202 len: 0 microversion: 2.1 time: 0.295105 Apr 12 12:52:37 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 282/858] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:52:36 2023] DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments/02c22408-e0c3-41e4-817c-dc6057451b06 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:52:37 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-86e5f1bf-3ad3-4b99-b35a-b490ca16e5f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: .version_select at 0x7fc95d181360>, body: {"keypair": {"name": "tempest-keypair-1839792919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLQV4OYLyMmtyTwZQdfM7eQv90t/w0Zy18uxOBWsTm7SBpfqSmHMZQX/a46Mf0UUJAryT8HawQd0Kl3bVzgXGFh3W1gBTGM674XVwhaaRT7BEtN9RyRIJIyGrXcCufZzg=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:37 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-86e5f1bf-3ad3-4b99-b35a-b490ca16e5f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:52:37 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-86e5f1bf-3ad3-4b99-b35a-b490ca16e5f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:52:37 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-86e5f1bf-3ad3-4b99-b35a-b490ca16e5f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082411 Apr 12 12:52:37 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 289/859] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:52:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-340676982", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e211a286-ade0-4930-a327-4c6a41785094"}], "security_groups": [{"name": "tempest-securitygroup--644062454"}], "key_name": "tempest-keypair-1839792919", "user_data": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:38 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] validate_networks() for [('e211a286-ade0-4930-a327-4c6a41785094', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:52:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7d514f3d-a23c-4d0b-8b76-629a1a0008b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.613364 Apr 12 12:52:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 289/860] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:52:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-57c76bb9-02e2-42ca-a77c-603e93cb4376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-57c76bb9-02e2-42ca-a77c-603e93cb4376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-57c76bb9-02e2-42ca-a77c-603e93cb4376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:52:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-57c76bb9-02e2-42ca-a77c-603e93cb4376 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 200 len: 1235 microversion: 2.1 time: 0.066219 Apr 12 12:52:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 283/861] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:39 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:52:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Going to try to stop instance {{(pid=61615) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 12:52:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fee1d10c-f5e4-47a9-9e68-07a919c18536 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action" status: 202 len: 0 microversion: 2.1 time: 0.128140 Apr 12 12:52:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 290/862] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:52:39 2023] POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:52:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b11448af-42dc-4602-a508-c664387f3bee tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1666 microversion: 2.1 time: 0.212442 Apr 12 12:52:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 290/863] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:39 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1666 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-unplugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] Creating event network-vif-unplugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:52:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-d5b23779-bb16-4afa-bebe-2f0af3cc31fb req-8272844a-30cc-4bca-b0c0-b45f71e3c11c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035398 Apr 12 12:52:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 284/864] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] Creating event network-changed:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:52:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f61510dd-4672-4b58-b520-cfb95888ceb0 req-f3823805-bbd2-42b2-97ec-67e70addf2b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Apr 12 12:52:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 291/865] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:41 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:52:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c87cb3fa-3ad5-4729-acc0-a4a6644a7192 req-ae5f00ca-6e9d-4e58-94b1-d8ab5a448e54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030882 Apr 12 12:52:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 291/866] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:52:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "name": "network-vif-plugged", "status": "completed", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}, {"server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "name": "network-vif-plugged", "status": "completed", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:52:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Creating event network-vif-plugged:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:52:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] Creating event network-vif-plugged:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:52:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-665fdbef-adf7-4308-9071-cc009c88c21d req-5f495298-54a2-406c-a647-50ce7be9a69b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033141 Apr 12 12:52:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 285/867] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:52:51 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:52:51 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fe7aa6fb-aa8a-4bb4-90d7-7c24ade543f9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1749 microversion: 2.1 time: 0.160501 Apr 12 12:52:51 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 292/868] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:52:51 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:53:01 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 HTTP/1.1 Apr 12 12:53:01 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:53:01 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:53:01 user devstack@n-api.service[61614]: Connection: close Apr 12 12:53:01 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:53:01 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:53:01 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:53:01 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:53:01 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:01 user devstack@n-api.service[61614]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:01 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:53:01 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:53:01 user devstack@n-api.service[61614]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:53:01 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:01 user devstack@n-api.service[61614]: method: > Apr 12 12:53:01 user devstack@n-api.service[61614]: exception: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. Apr 12 12:53:01 user devstack@n-api.service[61614]: action_args: {'id': 'a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7'} Apr 12 12:53:01 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. Apr 12 12:53:01 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:53:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:53:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b97645ff-2d2f-44f8-8dd2-5008f448ce8f tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7" status: 404 len: 111 microversion: 2.1 time: 0.040234 Apr 12 12:53:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 292/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:53:01 2023] GET /compute/v2.1/servers/a7b8c39c-77a4-4b2f-b1b0-42c5f4846cf7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:53:05 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 HTTP/1.1 Apr 12 12:53:05 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:53:05 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:53:05 user devstack@n-api.service[61616]: Connection: close Apr 12 12:53:05 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:53:05 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:53:05 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:53:05 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:53:05 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61616]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:05 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:53:05 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:53:05 user devstack@n-api.service[61616]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:53:05 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:05 user devstack@n-api.service[61616]: method: > Apr 12 12:53:05 user devstack@n-api.service[61616]: exception: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61616]: action_args: {'id': '546c0c08-35f1-4043-ac30-56d49bc86af1'} Apr 12 12:53:05 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:53:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-dbbb74dc-3b3c-4a59-98fc-bc4e29d10bcb tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 404 len: 111 microversion: 2.1 time: 0.058847 Apr 12 12:53:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 286/870] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:53:05 2023] DELETE /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] [instance: 546c0c08-35f1-4043-ac30-56d49bc86af1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] HTTP exception thrown: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Request method failure captured: Apr 12 12:53:05 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 HTTP/1.1 Apr 12 12:53:05 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:53:05 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:53:05 user devstack@n-api.service[61615]: Connection: close Apr 12 12:53:05 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:53:05 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:53:05 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:53:05 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:53:05 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqPiDD23BKiT3gM4RlcTPVJA--PITYfAMj2GP9g4k9euss2hoaW4vaYvtLgVVxkcB-bsT7QqgM9trmI16YF0_KXDry2KExPY2DCHrxerVDTAGgeJJOGQu3300BdsDv8NmTs342rrTeExFGPQW6MSHFZiGnhvHclc8BbPXS2gVcFalls Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Project-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Project-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ba5375005114c8594e0ae86b2f19093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Tenant: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Tenant-Id: 7ba5375005114c8594e0ae86b2f19093 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-ServerActionsTestJSON-1233797030 Apr 12 12:53:05 user devstack@n-api.service[61615]: X-User: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:05 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:53:05 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:53:05 user devstack@n-api.service[61615]: X-User-Id: 29f7f46d32f4465ba3e8b504c645c22f Apr 12 12:53:05 user devstack@n-api.service[61615]: X-User-Name: tempest-ServerActionsTestJSON-1233797030-project-member Apr 12 12:53:05 user devstack@n-api.service[61615]: method: > Apr 12 12:53:05 user devstack@n-api.service[61615]: exception: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61615]: action_args: {'id': '546c0c08-35f1-4043-ac30-56d49bc86af1'} Apr 12 12:53:05 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:53:05 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:53:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:53:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:53:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:53:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. Apr 12 12:53:06 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:53:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Returning 404 to user: Instance 546c0c08-35f1-4043-ac30-56d49bc86af1 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:53:06 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-c98bce9e-442a-4570-81f6-90e80a1fd4f3 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1" status: 404 len: 111 microversion: 2.1 time: 0.037173 Apr 12 12:53:06 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 293/871] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:53:05 2023] GET /compute/v2.1/servers/546c0c08-35f1-4043-ac30-56d49bc86af1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:53:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d299aed3-4a91-4164-bfff-14307d3f14f2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] Calling method '.version_select at 0x7fc95d3ede10>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d299aed3-4a91-4164-bfff-14307d3f14f2 tempest-ServerActionsTestJSON-1233797030 tempest-ServerActionsTestJSON-1233797030-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245622558" status: 202 len: 0 microversion: 2.1 time: 0.025526 Apr 12 12:53:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 293/872] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:53:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245622558 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1011361966", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "bb52f82e-56ca-41f7-b171-a3cacb549ef5"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] validate_networks() for [('bb52f82e-56ca-41f7-b171-a3cacb549ef5', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:53:17 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for user 435e0d6fd2b3437f837e82730b4d955f and project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:53:18 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:53:18 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-646ac3bc-c41a-4535-b6b5-995e50faa59e tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.768699 Apr 12 12:53:18 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 287/873] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 12:53:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:53:18 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:53:18 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b6fe31c7-a232-477c-be74-26a0b2f7b808 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 200 len: 1395 microversion: 2.87 time: 0.092084 Apr 12 12:53:18 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 294/874] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:53:18 2023] GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 1395 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] Creating event network-changed:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 12:53:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c53a4777-d5f7-43c2-b675-f260d4230701 req-9c16f6aa-c588-46e8-9326-41145e407f5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037529 Apr 12 12:53:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 294/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:53:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:53:22 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "name": "network-vif-plugged", "status": "completed", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] Creating event network-vif-plugged:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 12:53:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-e182cf26-f6d2-442c-be9b-55a66060c9f7 req-660eb742-81b3-4b1a-bd0b-a520136c1f53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040134 Apr 12 12:53:22 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 288/876] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:53:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "name": "network-vif-plugged", "status": "completed", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] Creating event network-vif-plugged:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 12:53:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-71101226-4697-49c2-8dc4-d833b8ef6ca9 req-d5012f23-f077-4922-8a93-b72cc9f8916a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Apr 12 12:53:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 295/877] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:29 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:53:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-af5a045a-f611-4896-97c2-3252523b766b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 200 len: 1545 microversion: 2.1 time: 0.170789 Apr 12 12:53:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 295/878] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:53:29 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:29 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:53:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-72613222-f4de-4cbf-8077-d69f689326ea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1643 microversion: 2.1 time: 0.167793 Apr 12 12:53:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 289/879] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:53:29 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2094617542"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:51 user devstack@n-api.service[61615]: INFO nova.network.security_group_api [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Removing security group e90cc693-a8a5-46ea-8940-f1b877d09154 from port dab72490-cdfa-4ffa-be0b-feda75d66bcb Apr 12 12:53:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ac59efdc-bccf-4017-8b18-3ebf6cd0e05f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action" status: 202 len: 0 microversion: 2.1 time: 0.596093 Apr 12 12:53:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 296/880] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:53:51 2023] POST /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508746c9-705a-4d77-a528-454a10299411", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] Creating event network-changed:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:53:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-4f773bba-a61c-454a-851f-eb75c47a0648 req-bd975e5c-c1ac-47ad-9337-17822b763d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039428 Apr 12 12:53:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 296/881] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:53 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'services' on Instance uuid 508746c9-705a-4d77-a528-454a10299411 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:53:53 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-35eceddd-cde7-4290-805f-90952782b4b7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments/3675f4a6-a994-41d9-9477-08b2f072dae0" status: 202 len: 0 microversion: 2.1 time: 0.303323 Apr 12 12:53:53 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 290/882] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:53:53 2023] DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments/3675f4a6-a994-41d9-9477-08b2f072dae0 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:53 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:53 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-11d00406-55c4-4c71-815a-8c3f23dc99b3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050099 Apr 12 12:53:53 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 297/883] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:53:53 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:53:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508746c9-705a-4d77-a528-454a10299411", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:53:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:53:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:53:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:53:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] Creating event network-changed:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:53:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-981dc29e-9a29-429b-a4d7-9c6fa9295d59 req-a84c1270-03b9-4cea-8201-1ac011d9320d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031573 Apr 12 12:53:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 297/884] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:54:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:54:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2df055f0-02d7-4ee1-a523-c528e66707c4 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 200 len: 1691 microversion: 2.87 time: 0.218003 Apr 12 12:54:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 291/885] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:54:08 2023] GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=10 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-57c17f69-cc5b-47fc-ae9f-8fc81d0d7db0 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.190809 Apr 12 12:54:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 298/886] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:54:29 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-interface => generated 283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:30 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Going to try to start instance {{(pid=61614) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 12:54:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-79c7653e-9e6b-44d2-88e0-64f5b5790420 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action" status: 202 len: 0 microversion: 2.1 time: 0.080251 Apr 12 12:54:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 298/887] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:54:30 2023] POST /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:30 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:54:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-d42a5453-e9a4-4034-842e-7c3392de396d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1652 microversion: 2.1 time: 0.635726 Apr 12 12:54:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 292/888] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:54:30 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1652 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:54:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] Creating event network-changed:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:54:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d00f273c-8321-4927-8c9c-2a312c10f0b8 req-b714d34c-e5c0-40f3-b6b0-62aeca5cf386 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028669 Apr 12 12:54:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 299/889] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3cbea8d3-6154-4a44-950c-a4efe26c86b3 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/ips" status: 200 len: 109 microversion: 2.1 time: 0.040732 Apr 12 12:54:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:54:31 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51ec7610-bca2-4a85-8987-3a7ecb7e7ee5"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-79770463-fa72-4b54-ac3d-e984767daa31 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348211 Apr 12 12:54:32 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 293/891] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:54:32 2023] POST /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:33 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:33 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:54:33 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-1a3f3cf5-5fb2-48f9-95b5-8a0fe5af58a5 req-49bf9672-d44d-4b64-b8fc-d6da4db9491d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038943 Apr 12 12:54:33 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 300/892] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:54:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-59473d7f-50b1-4502-8df9-edfaaceef567 req-5d5ea250-7e1f-4732-8f88-704d33cb1112 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030055 Apr 12 12:54:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51ec7610-bca2-4a85-8987-3a7ecb7e7ee5"}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 12:54:40 user devstack@n-api.service[61616]: request: POST /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments HTTP/1.1 Apr 12 12:54:40 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:54:40 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:54:40 user devstack@n-api.service[61616]: Connection: close Apr 12 12:54:40 user devstack@n-api.service[61616]: Content-Length: 74 Apr 12 12:54:40 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:54:40 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:54:40 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:54:40 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:54:40 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:54:40 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:54:40 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 12:54:40 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:54:40 user devstack@n-api.service[61616]: Apr 12 12:54:40 user devstack@n-api.service[61616]: {"volumeAttachment": {"volumeId": "51ec7610-bca2-4a85-8987-3a7ecb7e7ee5"}} Apr 12 12:54:40 user devstack@n-api.service[61616]: method: > Apr 12 12:54:40 user devstack@n-api.service[61616]: exception: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded Apr 12 12:54:40 user devstack@n-api.service[61616]: action_args: {'server_id': '2647400c-e0e8-4fcb-9fa6-b4ab35197ded', 'body': {'volumeAttachment': {'volumeId': '51ec7610-bca2-4a85-8987-3a7ecb7e7ee5'}}} Apr 12 12:54:40 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded Apr 12 12:54:40 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:54:40 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 400 to user: Invalid volume: volume 51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 is already attached to instances: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:54:40 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ec455ad6-555f-4f7d-b4c0-70ec1408c37b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.192364 Apr 12 12:54:40 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 294/894] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:54:40 2023] POST /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'services' on Instance uuid 2647400c-e0e8-4fcb-9fa6-b4ab35197ded {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:54:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5fc082a3-5f94-4c5e-8e84-03b0ecf4f917 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments/51ec7610-bca2-4a85-8987-3a7ecb7e7ee5" status: 202 len: 0 microversion: 2.1 time: 0.178182 Apr 12 12:54:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 301/895] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:54:40 2023] DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments/51ec7610-bca2-4a85-8987-3a7ecb7e7ee5 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-943d808b-e933-4d11-9454-cb3b63d198bd tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053278 Apr 12 12:54:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 301/896] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:54:40 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-71d71947-7e4e-4bd9-b332-a44482ac1dba tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053205 Apr 12 12:54:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 295/897] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:54:43 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HTTP exception thrown: Instance 508746c9-705a-4d77-a528-454a10299411 is not attached to volume 3675f4a6-a994-41d9-9477-08b2f072dae0 Apr 12 12:54:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Request method failure captured: Apr 12 12:54:44 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments/3675f4a6-a994-41d9-9477-08b2f072dae0 HTTP/1.1 Apr 12 12:54:44 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:54:44 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:54:44 user devstack@n-api.service[61615]: Connection: close Apr 12 12:54:44 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:54:44 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:54:44 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:54:44 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:54:44 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqjngHT4XSykoNJfeFU03ov7-3UXEphY4ah4u09nQcuJOpk_OxNgL-8coelFN-4JA6cgEAyttxv-I-KnQc1lO41AuHm3zCtypZvqX5tUyWea7h6xrMSTK9s76i3_0RJ7XDnByAriKaA0T__fjtwq9OV8Ml0bZ6CG3U6fEQ2gnm7KvrE Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Project-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Tenant: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Tenant-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-User: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 12:54:44 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:54:44 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:54:44 user devstack@n-api.service[61615]: X-User-Id: 924c3a968d734a1c9ddfc5a44d8f6352 Apr 12 12:54:44 user devstack@n-api.service[61615]: X-User-Name: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 12:54:44 user devstack@n-api.service[61615]: method: > Apr 12 12:54:44 user devstack@n-api.service[61615]: exception: Instance 508746c9-705a-4d77-a528-454a10299411 is not attached to volume 3675f4a6-a994-41d9-9477-08b2f072dae0 Apr 12 12:54:44 user devstack@n-api.service[61615]: action_args: {'server_id': '508746c9-705a-4d77-a528-454a10299411', 'id': '3675f4a6-a994-41d9-9477-08b2f072dae0'} Apr 12 12:54:44 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3675f4a6-a994-41d9-9477-08b2f072dae0. Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508746c9-705a-4d77-a528-454a10299411 is not attached to volume 3675f4a6-a994-41d9-9477-08b2f072dae0 Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508746c9-705a-4d77-a528-454a10299411 is not attached to volume 3675f4a6-a994-41d9-9477-08b2f072dae0 Apr 12 12:54:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:54:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Returning 404 to user: Instance 508746c9-705a-4d77-a528-454a10299411 is not attached to volume 3675f4a6-a994-41d9-9477-08b2f072dae0 {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:54:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-04422377-03cc-469c-8831-11652c9d571c tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments/3675f4a6-a994-41d9-9477-08b2f072dae0" status: 404 len: 154 microversion: 2.1 time: 0.098163 Apr 12 12:54:44 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 302/898] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:54:43 2023] DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411/os-volume_attachments/3675f4a6-a994-41d9-9477-08b2f072dae0 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:46 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:54:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-553e4d04-dd54-449c-9ab8-1dbd6410a2e4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 204 len: 0 microversion: 2.1 time: 0.109957 Apr 12 12:54:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 302/899] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:54:46 2023] DELETE /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:46 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:54:46 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-412965ea-af0a-457b-a6c8-9cd4cf38f903 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 200 len: 1544 microversion: 2.1 time: 0.199335 Apr 12 12:54:46 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 296/900] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:54:46 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:54:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-unplugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] Creating event network-vif-unplugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:54:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-2f777765-1da3-4349-b4ba-08e9f9153d23 req-a4c2ce4a-2f6d-4720-b124-503f7617ad3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042678 Apr 12 12:54:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 303/901] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:47 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-deleted", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] Creating event network-vif-deleted:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:54:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a1114d68-a1a9-444e-a55c-ff6fe664c967 req-d38f3ecb-ede3-487d-b644-75cb1c87f270 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033831 Apr 12 12:54:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:54:48 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508746c9-705a-4d77-a528-454a10299411", "name": "network-vif-plugged", "status": "completed", "tag": "dab72490-cdfa-4ffa-be0b-feda75d66bcb"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:54:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:54:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:54:48 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:54:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] Creating event network-vif-plugged:dab72490-cdfa-4ffa-be0b-feda75d66bcb for instance 508746c9-705a-4d77-a528-454a10299411 on user Apr 12 12:54:48 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9a6bfd54-f3d2-4cc7-a074-78e478b55774 req-bfde65f6-42dd-4c2f-850d-9e7c0a0899be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Apr 12 12:54:48 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 297/903] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:54:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1963932811"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:09 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-cd9548b6-0d5c-4fcd-936a-2a232e415453 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/action" status: 202 len: 52 microversion: 2.87 time: 0.835592 Apr 12 12:55:09 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 304/904] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:55:08 2023] POST /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26/action => generated 52 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:15 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:16 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-41a9dbe4-eef7-4c0e-85b3-577af9034c2b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 200 len: 1691 microversion: 2.87 time: 0.398468 Apr 12 12:55:16 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 304/905] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:55:15 2023] GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 1691 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=12 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-6ce25cc1-80b8-422b-810d-ce0bc6b4f8ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1656 microversion: 2.1 time: 0.151691 Apr 12 12:55:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 298/906] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:55:20 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-094f2277-a4ee-488e-9027-33216679598a tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049507 Apr 12 12:55:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 305/907] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:55:30 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:31 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:55:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a9454004-0d6d-447a-a6f0-2bdbde000566 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 204 len: 0 microversion: 2.1 time: 0.140165 Apr 12 12:55:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:55:31 2023] DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:31 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-627c9f06-19a6-4d44-bd61-2818a0053070 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 200 len: 1670 microversion: 2.1 time: 0.185388 Apr 12 12:55:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 299/909] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:55:31 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 12:55:31 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "name": "network-vif-unplugged", "status": "completed", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] Creating event network-vif-unplugged:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:55:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a594941c-5652-4cf7-b68e-0a31e4b83492 req-6852c2a7-e169-42e3-befa-895a455a0d0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030582 Apr 12 12:55:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 306/910] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "name": "network-vif-deleted", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] Creating event network-vif-deleted:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:55:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-f223d4b2-5321-49cb-b2c7-478a0d6b2f12 req-c20ab47a-1561-4272-961d-de121a9f4313 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103243 Apr 12 12:55:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 306/911] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:33 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2647400c-e0e8-4fcb-9fa6-b4ab35197ded", "name": "network-vif-plugged", "status": "completed", "tag": "905fcda2-3c86-4694-a6a5-8a3ba5caddc2"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] Creating event network-vif-plugged:905fcda2-3c86-4694-a6a5-8a3ba5caddc2 for instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded on user Apr 12 12:55:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-2d421082-cfb8-468c-98fd-7a7b3114b3d7 req-23e6e94b-20b0-401a-97e0-b54cef8c38be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028986 Apr 12 12:55:33 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 300/912] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: 508746c9-705a-4d77-a528-454a10299411] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HTTP exception thrown: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Request method failure captured: Apr 12 12:55:36 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 HTTP/1.1 Apr 12 12:55:36 user devstack@n-api.service[61615]: Accept: application/json Apr 12 12:55:36 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 12:55:36 user devstack@n-api.service[61615]: Connection: close Apr 12 12:55:36 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 12:55:36 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 12:55:36 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 12:55:36 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 12:55:36 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqjngHT4XSykoNJfeFU03ov7-3UXEphY4ah4u09nQcuJOpk_OxNgL-8coelFN-4JA6cgEAyttxv-I-KnQc1lO41AuHm3zCtypZvqX5tUyWea7h6xrMSTK9s76i3_0RJ7XDnByAriKaA0T__fjtwq9OV8Ml0bZ6CG3U6fEQ2gnm7KvrE Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Project-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Tenant: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Tenant-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-User: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 12:55:36 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 12:55:36 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 12:55:36 user devstack@n-api.service[61615]: X-User-Id: 924c3a968d734a1c9ddfc5a44d8f6352 Apr 12 12:55:36 user devstack@n-api.service[61615]: X-User-Name: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 12:55:36 user devstack@n-api.service[61615]: method: > Apr 12 12:55:36 user devstack@n-api.service[61615]: exception: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. Apr 12 12:55:36 user devstack@n-api.service[61615]: action_args: {'id': '508746c9-705a-4d77-a528-454a10299411'} Apr 12 12:55:36 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. Apr 12 12:55:36 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 12:55:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Returning 404 to user: Instance 508746c9-705a-4d77-a528-454a10299411 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:55:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4d2c45cd-1ae5-4112-b000-aef52e11f4bb tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411" status: 404 len: 111 microversion: 2.1 time: 0.136770 Apr 12 12:55:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 307/913] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:55:36 2023] GET /compute/v2.1/servers/508746c9-705a-4d77-a528-454a10299411 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:55:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5769f058-409c-4e21-856b-cbf586e6aa38 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '.version_select at 0x7fc95d1d5ab0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5769f058-409c-4e21-856b-cbf586e6aa38 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1590711499" status: 202 len: 0 microversion: 2.1 time: 0.023201 Apr 12 12:55:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 307/914] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 12:55:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1590711499 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:55:38 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-07d13869-a5c0-4d3d-94ec-f2dd9dee1283 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: .version_select at 0x7fc95d346c20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1710707159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYCqWk/TodEqXsFi9a7cw3/KtXFhdAQR1LawDDCKO0HiyA4rhVlzn+IXohB9sc83lFxQA8eJtIOy2mHpy8PwlgJxikvBMjWpAvkMzRpwgQMaxEEQSVlwbt2ix9mDjAByw=="}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-07d13869-a5c0-4d3d-94ec-f2dd9dee1283 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:55:38 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-07d13869-a5c0-4d3d-94ec-f2dd9dee1283 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for user 924c3a968d734a1c9ddfc5a44d8f6352 and project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'key_pairs'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:55:38 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-07d13869-a5c0-4d3d-94ec-f2dd9dee1283 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056226 Apr 12 12:55:38 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 301/915] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:55:38 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-976781852", "imageRef": "f4fa635a-1809-4235-81a6-a8a97e8cf13c", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1710707159", "networks": [{"uuid": "76f8fc2b-41cf-4efd-9820-c4d4056deaca"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] validate_networks() for [('76f8fc2b-41cf-4efd-9820-c4d4056deaca', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Getting quotas for user 924c3a968d734a1c9ddfc5a44d8f6352 and project 2f411f36f23e464fa4a395ad6b2b4472. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:55:39 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f4fa635a-1809-4235-81a6-a8a97e8cf13c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:55:39 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4fe53259-f90f-440c-b04f-f72b8476cee0 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.574018 Apr 12 12:55:39 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 308/916] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:55:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:55:39 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-af268605-dbf3-4b08-bca4-a135bae8fcf3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:55:39 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-af268605-dbf3-4b08-bca4-a135bae8fcf3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:55:39 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-af268605-dbf3-4b08-bca4-a135bae8fcf3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:55:39 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-af268605-dbf3-4b08-bca4-a135bae8fcf3 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1252 microversion: 2.1 time: 0.094800 Apr 12 12:55:39 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 308/917] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:55:39 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1252 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:55:42 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:42 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] Creating event network-changed:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:55:42 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-67ca3bbd-52a1-4533-8cab-a06fb3f3039c req-a30434aa-354d-4e9f-ac17-f3592fda85f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063501 Apr 12 12:55:42 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 302/918] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:55:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a71590d0-907c-49cb-9b1d-3760bad8e847 req-6c9b89ec-f579-4f8f-9c1a-c0a6a09396b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Apr 12 12:55:44 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 309/919] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:55:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:55:46 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:55:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:55:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:55:46 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:55:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:55:46 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-e61bfdbe-f075-4d67-a517-6a5c5b3e2e14 req-e912f443-66c5-4f2f-9674-35090cf6c812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062478 Apr 12 12:55:46 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 309/920] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1998019959", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "bb52f82e-56ca-41f7-b171-a3cacb549ef5"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] validate_networks() for [('bb52f82e-56ca-41f7-b171-a3cacb549ef5', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for user 435e0d6fd2b3437f837e82730b4d955f and project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:56:16 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:56:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-41869fd2-58a8-4a3e-a9b5-9c71b23b0eee tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.526693 Apr 12 12:56:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 303/921] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 12:56:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=14 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:16 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8294ccb5-ec89-4517-a7a4-ba462335a59a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1395 microversion: 2.87 time: 0.098892 Apr 12 12:56:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 310/922] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:56:16 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1395 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:18 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] Creating event network-changed:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:56:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-7131336c-24b9-4374-b510-bad947afd96b req-91797f52-3678-4f45-a308-f0978a916037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041887 Apr 12 12:56:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 310/923] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-24cbd85c-d99f-4851-a43f-e3cd1dccc439 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044538 Apr 12 12:56:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 304/924] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:56:21 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:56:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a1e95105-0f12-44bb-913b-4146983433aa tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 204 len: 0 microversion: 2.1 time: 0.119635 Apr 12 12:56:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 311/925] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:56:21 2023] DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 12:56:21 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded HTTP/1.1 Apr 12 12:56:21 user devstack@n-api.service[61616]: Accept: application/json Apr 12 12:56:21 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 12:56:21 user devstack@n-api.service[61616]: Connection: close Apr 12 12:56:21 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 12:56:21 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 12:56:21 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 12:56:21 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 12:56:21 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:56:21 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 12:56:21 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 12:56:21 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 12:56:21 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 12:56:21 user devstack@n-api.service[61616]: method: > Apr 12 12:56:21 user devstack@n-api.service[61616]: exception: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 12:56:21 user devstack@n-api.service[61616]: action_args: {'id': '2647400c-e0e8-4fcb-9fa6-b4ab35197ded'} Apr 12 12:56:21 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 12:56:21 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:56:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-860aa7d8-39b7-4e97-b103-a92d26c5f1a9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 404 len: 111 microversion: 2.1 time: 0.029520 Apr 12 12:56:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 305/926] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:56:21 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1f52dca5-50b8-4d9c-b962-525a1d22bfb6 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '.version_select at 0x7fc95d24dea0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1f52dca5-50b8-4d9c-b962-525a1d22bfb6 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839792919" status: 202 len: 0 microversion: 2.1 time: 0.032503 Apr 12 12:56:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 312/927] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:56:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839792919 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-62b8ea7f-f0a0-4c84-a966-e758920afc6f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 200 len: 1662 microversion: 2.1 time: 0.205329 Apr 12 12:56:21 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 311/928] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:56:21 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-unplugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:21 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] Creating event network-vif-unplugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:56:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9da5d00a-898d-4981-a88a-880fddd6660a req-dab64c9a-37db-4aa3-b631-e67d2c335bc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083018 Apr 12 12:56:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 306/929] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fa62e44d-8aa8-477f-9582-d34471553ba9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: .version_select at 0x7fc95d3b68c0>, body: {"keypair": {"name": "tempest-keypair-1304891791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmFPVnE4tAmO1yvRexE4d4I4G/HJpMr2SSk8OHxjALBh+f9CTblVVcbe0HlQ0Ch4FIcsGZHFLQnnDkwtJS/ZH/cxRy05QKijU/FHTuCeYRAgiZ/fISBnryI0uJ+P1pLA=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:22 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fa62e44d-8aa8-477f-9582-d34471553ba9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:56:22 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-fa62e44d-8aa8-477f-9582-d34471553ba9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:56:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fa62e44d-8aa8-477f-9582-d34471553ba9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.316574 Apr 12 12:56:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 313/930] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:56:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-deleted", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] Creating event network-vif-deleted:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:56:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9fa310f9-65d6-4b0a-8b09-962feaca4e46 req-0c4584c9-d3f9-460d-9dc0-a004a0d74d10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038561 Apr 12 12:56:23 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 312/931] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9f1454-9e3c-40d4-849b-c13537d6be97", "name": "network-vif-plugged", "status": "completed", "tag": "9c30bdfa-5f39-4454-af8b-f2ccd880807b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] Creating event network-vif-plugged:9c30bdfa-5f39-4454-af8b-f2ccd880807b for instance db9f1454-9e3c-40d4-849b-c13537d6be97 on user Apr 12 12:56:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-2fbab5a9-7c2f-43f0-ae6d-87b1454135c7 req-395ffba5-9f5e-4ea8-a234-039bee0895c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041751 Apr 12 12:56:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 307/932] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2056889362", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e211a286-ade0-4930-a327-4c6a41785094"}], "security_groups": [{"name": "tempest-securitygroup--444965977"}], "key_name": "tempest-keypair-1304891791", "user_data": "}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] validate_networks() for [('e211a286-ade0-4930-a327-4c6a41785094', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Getting quotas for user a3d9f4516bee4f8d9af7a40ed1298f03 and project e61975273ccb41229e0138b96eb7f5e9. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:56:24 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:56:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-de1c9c7c-e2ad-48f2-89a7-e8169fa44879 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.525944 Apr 12 12:56:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 314/933] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:56:24 2023] POST /compute/v2.1/servers => generated 399 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:56:24 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-887dd95c-4264-49de-9cac-5be007db0690 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:24 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-887dd95c-4264-49de-9cac-5be007db0690 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:24 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-887dd95c-4264-49de-9cac-5be007db0690 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-887dd95c-4264-49de-9cac-5be007db0690 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 200 len: 1236 microversion: 2.1 time: 0.073616 Apr 12 12:56:24 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 313/934] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:56:24 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:27 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] Creating event network-changed:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:56:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-db7a8dd7-bcba-48fa-b228-9ff19335e12b req-f7722351-fb16-4b94-a863-5902195f8da0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045932 Apr 12 12:56:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 308/935] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:29 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:56:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2550f7fc-ee77-4f89-985c-ea1255e4340f tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1536 microversion: 2.1 time: 0.142505 Apr 12 12:56:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 315/936] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:56:29 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1536 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:56:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "name": "network-vif-plugged", "status": "completed", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] Creating event network-vif-plugged:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:56:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1344b07d-d96c-4872-8e9e-a5d0033562ff req-5eea21b8-d366-4d62-8b98-3078187a8119 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 Apr 12 12:56:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 314/937] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:56:32 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "name": "network-vif-plugged", "status": "completed", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}, {"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}, {"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:56:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:56:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:56:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:56:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Creating event network-vif-plugged:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:56:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:56:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:56:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-57e7e541-6979-4eb4-b345-60bcd0247bdd req-635f7d0a-c059-4b8f-9315-2e8e4ef4fe8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063094 Apr 12 12:56:32 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 309/938] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=12 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:06 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:07 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:07 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ac076113-90eb-4e86-8a9b-d5b1346adacb tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1770 microversion: 2.87 time: 0.221822 Apr 12 12:57:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 316/939] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:57:06 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1770 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 12:57:11 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 HTTP/1.1 Apr 12 12:57:11 user devstack@n-api.service[61614]: Accept: application/json Apr 12 12:57:11 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 12:57:11 user devstack@n-api.service[61614]: Connection: close Apr 12 12:57:11 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 12:57:11 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 12:57:11 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 12:57:11 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 12:57:11 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 12:57:11 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 12:57:11 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 12:57:11 user devstack@n-api.service[61614]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 12:57:11 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 12:57:11 user devstack@n-api.service[61614]: method: > Apr 12 12:57:11 user devstack@n-api.service[61614]: exception: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 12:57:11 user devstack@n-api.service[61614]: action_args: {'id': 'db9f1454-9e3c-40d4-849b-c13537d6be97'} Apr 12 12:57:11 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 12:57:11 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 12:57:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 12:57:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-952e69d7-9cf0-4187-b9a0-0b942b8e2fea tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 404 len: 111 microversion: 2.1 time: 0.044087 Apr 12 12:57:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 315/940] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:11 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 12:57:11 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:11 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=18 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:11 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-15726286-a488-4bd1-93fc-8f51af9f9f65 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '.version_select at 0x7fc95d345000>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-15726286-a488-4bd1-93fc-8f51af9f9f65 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238241126" status: 202 len: 0 microversion: 2.1 time: 0.031250 Apr 12 12:57:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 310/941] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 12:57:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238241126 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:57:12 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-72798c3e-3487-45c5-8bda-89efbe1de1ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: .version_select at 0x7fc95d181ab0>, body: {"keypair": {"name": "tempest-keypair-990566308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+VqciJ+AVvCe/N0xwWOn/nJY1e4lfokIJeJ1FKR2w8X6Y9f/4CVW/1X9EydJvxQYb4/9jutiZdSGF9cw4hZDSkkxaTg/Y/3AIuAySVrBR5vodpwIgm/ehG2VQ4V0w+AQ=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:12 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-72798c3e-3487-45c5-8bda-89efbe1de1ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:57:12 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-72798c3e-3487-45c5-8bda-89efbe1de1ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for user 8a9c54033c7547c2bae91e6c1dba0976 and project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:57:12 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-72798c3e-3487-45c5-8bda-89efbe1de1ae tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043123 Apr 12 12:57:12 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 317/942] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 12:57:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-65757566", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e1afe3b3-a919-4800-9f1c-c8e602defd4f"}], "security_groups": [{"name": "tempest-securitygroup--818649820"}], "key_name": "tempest-keypair-990566308", "user_data": "}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] validate_networks() for [('e1afe3b3-a919-4800-9f1c-c8e602defd4f', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Getting quotas for user 8a9c54033c7547c2bae91e6c1dba0976 and project a0e6aaaa9a634f349d371f7c6c15eca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 12:57:14 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 12:57:14 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3d820fc8-e59f-448d-8149-99fc909d3cd9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.636783 Apr 12 12:57:14 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 316/943] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 12:57:14 2023] POST /compute/v2.1/servers => generated 399 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 12:57:14 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-51a01621-1d48-421d-8c35-379f14b80b7d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:14 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-51a01621-1d48-421d-8c35-379f14b80b7d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:14 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-51a01621-1d48-421d-8c35-379f14b80b7d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:14 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-51a01621-1d48-421d-8c35-379f14b80b7d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 200 len: 1229 microversion: 2.1 time: 0.072799 Apr 12 12:57:14 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 311/944] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:14 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 1229 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:15 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:15 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-6ad5727a-a2e3-4fbd-9ed5-81f6b0293f36 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 200 len: 1546 microversion: 2.1 time: 0.217164 Apr 12 12:57:15 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 318/945] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:14 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 1546 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] Creating event network-changed:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:57:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-34af886c-f258-4592-89cf-94aa29bf24c2 req-4f19a4ea-6dda-4252-b877-30f287b22797 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 Apr 12 12:57:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 317/946] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:57:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-78151827-c823-41e1-94cd-2b9328f77b6f req-a3f604c8-3a05-4e52-8c59-f61c8c422bf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117208 Apr 12 12:57:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 312/947] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:57:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-11765187-e67d-4226-84c9-0633771e2509 req-0c28b04d-5779-4994-9d09-5d1cc598852a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027308 Apr 12 12:57:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 319/948] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:30 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-df6ebc60-af96-4fa2-b5af-f17c55c9207a tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1536 microversion: 2.1 time: 0.214430 Apr 12 12:57:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 318/949] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:29 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1536 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Searching by: {'deleted': False, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472'} {{(pid=61616) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:30 user devstack@n-api.service[61616]: DEBUG nova.compute.multi_cell_list [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61616) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 12:57:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a27a0d0f-3170-4c1c-8aa9-1300b8f5dded tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.210481 Apr 12 12:57:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 313/950] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 12:57:30 2023] GET /compute/v2.1/servers => generated 340 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:30 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-01051a23-a320-4473-b35a-4a67d435f602 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1536 microversion: 2.1 time: 0.145895 Apr 12 12:57:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 320/951] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:30 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1536 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d5655e9-ab41-4361-a57b-817e42037463"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:32 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:32 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fbbb31e0-3ad8-4c1b-9c99-269ad80a85b4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385029 Apr 12 12:57:32 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 319/952] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:57:32 2023] POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:39 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7b3df0de-ead2-4e5d-9ae6-0822106a3ac2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1582 microversion: 2.1 time: 0.209041 Apr 12 12:57:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 314/953] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:39 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1582 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=20 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:41 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] Creating event network-changed:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:41 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-9c2488c9-f9d1-417b-b84b-ed65c4d62c97 req-6a401919-5247-4c21-ad33-1286aeb01ea7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032305 Apr 12 12:57:41 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 321/954] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-928520848"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:42 user devstack@n-api.service[61614]: INFO nova.network.security_group_api [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Adding security group 0dc48522-6ac1-4e6c-b10c-93e865898962 to port 7103abd2-88c5-437a-9661-64ca6379a130 Apr 12 12:57:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b26226a5-8e6c-4f9b-a8b8-102196494c87 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action" status: 202 len: 0 microversion: 2.1 time: 0.587531 Apr 12 12:57:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 320/955] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:57:42 2023] POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] Creating event network-changed:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9efbd915-554e-4054-a64a-76a67fb9400b req-6bdb9ae7-d402-45a9-927f-1092dfb56f75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035062 Apr 12 12:57:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 315/956] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:43 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-90607d32-fb24-4426-8547-3fb3a68df63b tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1747 microversion: 2.1 time: 0.155329 Apr 12 12:57:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 322/957] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:43 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4fdba8be-c3e1-4e20-bdc5-27525dce8f78 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action" status: 202 len: 0 microversion: 2.1 time: 0.095786 Apr 12 12:57:43 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 321/958] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:57:43 2023] POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:43 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:57:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fda48296-0f2b-4e35-9c62-45ba50bf49be tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1739 microversion: 2.1 time: 0.299265 Apr 12 12:57:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 316/959] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:57:43 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:57:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-unplugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] Creating event network-vif-unplugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-a035ccad-affa-4ff1-8d60-b7b0383ae2cf req-010ea5e3-917d-4008-8780-e1296507dc9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032820 Apr 12 12:57:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 323/960] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:48 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}, {"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}, {"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}, {"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-unplugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}, {"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Creating event network-vif-unplugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:48 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-783b4862-75b1-4283-996a-a0384e145b9d req-f4c180cb-1d5a-4587-834c-30b4d6b253ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.041519 Apr 12 12:57:48 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:57:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}, {"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:57:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:57:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:57:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:57:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:57:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-72ea0147-b185-4967-8671-f7e420bdc23b req-5fb1be2f-ed9e-4ff7-849c-96eaf943d085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031381 Apr 12 12:57:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 317/962] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=10 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:04 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:05 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-42a00977-ac03-4561-bfb1-f777b06355ef tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 200 len: 1535 microversion: 2.1 time: 0.197480 Apr 12 12:58:05 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 324/963] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:58:04 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 1535 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "88de56de-eb65-4f80-95d7-853e3d487914"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:07 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'flavor' on Instance uuid 38198e86-bd23-4196-98a0-79455206305f {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:58:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3100391a-4623-413b-a3e6-65923e27a8d8 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f/action" status: 200 len: 29 microversion: 2.87 time: 0.465986 Apr 12 12:58:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 323/964] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:58:07 2023] POST /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f/action => generated 29 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=24 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:07 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:08 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:08 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-7ca49711-6cd0-4428-8314-6d064d461696 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1776 microversion: 2.87 time: 0.235719 Apr 12 12:58:08 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 318/965] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:58:07 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1776 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:58:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-unplugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] Creating event network-vif-unplugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:58:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-6c3b4aa6-e381-444f-b930-bf9e669966d3 req-750ad10b-73d0-44c2-bf90-0e8a0b1f2d4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040537 Apr 12 12:58:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 325/966] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:58:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:58:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-533d124d-092b-44fa-a5d5-77ea0e814f27 req-81d7115c-c3d4-44cf-87ed-4b571091d3c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048328 Apr 12 12:58:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:12 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:12 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:12 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:58:12 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-c6c5c653-0ec3-4459-823b-371a35f203fc req-d623b5d4-1342-487f-a207-31361382d969 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 Apr 12 12:58:12 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 319/968] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:14 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:14 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:58:14 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-23589361-1f23-462a-a381-5d9836fd3947 req-ad236c70-d295-4c42-b9f1-df099a50f39d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Apr 12 12:58:14 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 326/969] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3e7a5f3b-812d-43ff-b89b-abdb7b7ff5ca tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.097523 Apr 12 12:58:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 325/970] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:58:15 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-interface => generated 283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:16 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:16 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] Creating event network-changed:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:58:16 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-44a77223-42c0-4034-85ff-9ab9dc6a4ea6 req-dc10c2a0-a513-401a-88b7-5a7a8fdccb62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Apr 12 12:58:16 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 320/971] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:16 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-33db4302-6761-4b52-b65b-3e156c88e9f8 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/ips" status: 200 len: 109 microversion: 2.1 time: 0.038537 Apr 12 12:58:16 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 327/972] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:58:16 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e75cd8ab-b2ce-40b3-886b-1853d6f49278"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:18 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-442b19de-7154-46f4-8879-13ab1be82595 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345101 Apr 12 12:58:18 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 326/973] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:58:17 2023] POST /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:26 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:27 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lazy-loading 'services' on Instance uuid 88c7dd97-0390-4b2b-b803-7ab023366fd4 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:58:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-56de5044-3c9b-42dc-bd0e-936a884c1cb5 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments/e75cd8ab-b2ce-40b3-886b-1853d6f49278" status: 202 len: 0 microversion: 2.1 time: 0.175881 Apr 12 12:58:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 321/974] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:58:26 2023] DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments/e75cd8ab-b2ce-40b3-886b-1853d6f49278 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=14 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:27 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:27 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-96acdf4c-588c-4bdc-8c3e-d4c78835c57d tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060383 Apr 12 12:58:27 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 328/975] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:58:27 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:33 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:34 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1f4a9dca-f2dc-4805-b6ff-a4a7ef63cd28 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1747 microversion: 2.1 time: 0.178518 Apr 12 12:58:34 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 327/976] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:58:33 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:58:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f003e2d4-39e6-457f-a157-301e55809f17 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1756 microversion: 2.87 time: 0.302714 Apr 12 12:58:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 322/977] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:58:58 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1756 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:05 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:05 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-de91e05d-6418-420f-ba82-0ff58a57efa3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.095348 Apr 12 12:59:05 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 329/978] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 12:59:05 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-interface => generated 283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] Creating event network-changed:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-b2d55008-3eea-496b-b90f-242478ae39d9 req-a8c792f7-d649-4005-a37b-c23390724360 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040249 Apr 12 12:59:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 328/979] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:06 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:06 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-30cd50b1-8989-4ee1-b255-27a6b8f8e111 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/ips" status: 200 len: 105 microversion: 2.1 time: 0.036655 Apr 12 12:59:06 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 323/980] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 12:59:06 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "872ce488-65b3-4306-9435-9ba79ed5df15"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:07 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7139fa22-110c-4e01-9387-773e0f6f0451 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294066 Apr 12 12:59:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 330/981] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:59:07 2023] POST /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-939ed7e8-9828-427b-bad7-9a8f6129fcb3 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049397 Apr 12 12:59:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 329/982] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:15 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-84fe0494-dcc9-4ec3-9ea7-f98fa92a7e8f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15" status: 200 len: 194 microversion: 2.1 time: 0.041405 Apr 12 12:59:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 324/983] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 12:59:15 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dbb7a14-a626-492d-b50e-f44ae00c03d0"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:16 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0eb4f946-9043-44ea-9175-cb51b4bb19e6 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273942 Apr 12 12:59:17 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 331/984] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 12:59:16 2023] POST /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4ff70f9b-4ddf-46f8-85de-f39baa61c3b2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043601 Apr 12 12:59:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 330/985] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:17 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:59:17 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5bfe919d-71bc-42a5-9c67-7fc0af2e286b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 204 len: 0 microversion: 2.1 time: 0.126507 Apr 12 12:59:17 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 325/986] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:59:17 2023] DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d9f4516bee4f8d9af7a40ed1298f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61975273ccb41229e0138b96eb7f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:59:17 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b5e3e062-3bb7-47dd-8b03-fff21a24ac8b tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 200 len: 1671 microversion: 2.1 time: 0.221939 Apr 12 12:59:17 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 332/987] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:59:17 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "name": "network-vif-unplugged", "status": "completed", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:17 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] Creating event network-vif-unplugged:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:59:17 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-38a310b4-81a2-47c2-b443-9375545443c6 req-12f0ef2e-5481-47d9-a2d9-8c8792b0cdef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038149 Apr 12 12:59:17 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 331/988] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "name": "network-vif-plugged", "status": "completed", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}, {"server_uuid": "88c7dd97-0390-4b2b-b803-7ab023366fd4", "name": "network-vif-deleted", "tag": "9b06c0b4-3cd0-4352-958a-1a39e37e7925"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:19 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Creating event network-vif-plugged:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:59:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] Creating event network-vif-deleted:9b06c0b4-3cd0-4352-958a-1a39e37e7925 for instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 on user Apr 12 12:59:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-5ce69637-8fe7-4219-8e3c-0848d887c8b6 req-406753ee-5316-43ef-8bcd-448aa8fe4a6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036636 Apr 12 12:59:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 326/989] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7d918660-9fcc-40c8-9273-67d3b7ffeb38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043646 Apr 12 12:59:23 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 333/990] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:23 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-dfeb6b82-f162-4bd9-865f-157e4c850cc4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15" status: 200 len: 194 microversion: 2.1 time: 0.068813 Apr 12 12:59:23 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 332/991] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 12:59:23 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:23 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'services' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:59:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5c758508-0ad0-4709-88bc-58e6d3c575b2 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15" status: 202 len: 0 microversion: 2.1 time: 0.221653 Apr 12 12:59:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 327/992] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:59:23 2023] DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/872ce488-65b3-4306-9435-9ba79ed5df15 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:26 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-30540bad-7c8a-4f6d-a866-89b8385aa69d tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/2dbb7a14-a626-492d-b50e-f44ae00c03d0" status: 200 len: 194 microversion: 2.1 time: 0.064481 Apr 12 12:59:26 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 334/993] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 12:59:26 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/2dbb7a14-a626-492d-b50e-f44ae00c03d0 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:26 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lazy-loading 'services' on Instance uuid 9ebf6f6b-3940-40fa-9a20-a28a957961e2 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:59:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-d1bfff11-17b5-440f-a3be-2daaa0a12a38 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/2dbb7a14-a626-492d-b50e-f44ae00c03d0" status: 202 len: 0 microversion: 2.1 time: 0.355659 Apr 12 12:59:26 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 333/994] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:59:26 2023] DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments/2dbb7a14-a626-492d-b50e-f44ae00c03d0 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-12fa8330-0c89-4cad-9c95-ee1c48c48cce tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066289 Apr 12 12:59:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 328/995] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:28 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-6646a961-9932-4293-a840-5e356b2911c9 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045848 Apr 12 12:59:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 335/996] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:29 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 12:59:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6c229c8d-76bd-4433-95e7-b2cec87c9b22 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 204 len: 0 microversion: 2.1 time: 0.127787 Apr 12 12:59:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 334/997] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 12:59:29 2023] DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9c54033c7547c2bae91e6c1dba0976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e6aaaa9a634f349d371f7c6c15eca2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:59:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fb589fe1-0b38-41de-8787-c4375266d917 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 200 len: 1659 microversion: 2.1 time: 0.169127 Apr 12 12:59:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 329/998] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 12:59:29 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 1659 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-unplugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] Creating event network-vif-unplugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d684b352-f345-4690-8d1f-e55aea578de2 req-b78b9f38-6ef4-44a6-a011-3fec56db65e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028079 Apr 12 12:59:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 336/999] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-deleted", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:30 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] Creating event network-vif-deleted:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-1163c2ca-f479-4bf8-854b-437d5c62e650 req-ef9ff857-91ba-4860-9ad5-72ebb555dc4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040261 Apr 12 12:59:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 335/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}, {"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}, {"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}, {"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-unplugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}, {"server_uuid": "9ebf6f6b-3940-40fa-9a20-a28a957961e2", "name": "network-vif-plugged", "status": "completed", "tag": "82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Creating event network-vif-unplugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] Creating event network-vif-plugged:82eff0a4-60a6-4a68-b3f9-59aa44b9bfdf for instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 on user Apr 12 12:59:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-7e7ef30c-1318-4bc4-867b-42243d1f7b70 req-41f2cf85-17b5-4503-81a8-2b16a91f7f5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.043602 Apr 12 12:59:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 330/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-928520848"}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:34 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:34 user devstack@n-api.service[61615]: INFO nova.network.security_group_api [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Removing security group 0dc48522-6ac1-4e6c-b10c-93e865898962 from port 7103abd2-88c5-437a-9661-64ca6379a130 Apr 12 12:59:35 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-7a60c95f-5072-446a-b786-20684addd351 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action" status: 202 len: 0 microversion: 2.1 time: 0.908327 Apr 12 12:59:35 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 337/1002] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 12:59:34 2023] POST /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:59:35 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:35 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] Creating event network-changed:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:59:35 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-cee72fbc-345d-40d3-a961-cbd449e8cb59 req-0f0160fd-d5c7-4db4-8f1f-8888da22f0a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034563 Apr 12 12:59:35 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 336/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=19 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:36 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] Creating event network-changed:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 12:59:36 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-db5b6430-efec-413c-a988-b1e7197703ad req-2735dc04-8082-4982-b5f1-10e9589ad6c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035653 Apr 12 12:59:36 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 338/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 12:59:36 user devstack@n-api.service[61616]: DEBUG nova.objects.instance [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lazy-loading 'services' on Instance uuid a73a4b87-a9a8-4b01-af1f-4b2a64554b54 {{(pid=61616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 12:59:36 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-98d9e95e-f6d7-4da0-9884-5a2c8efd72c7 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments/5d5655e9-ab41-4361-a57b-817e42037463" status: 202 len: 0 microversion: 2.1 time: 0.186887 Apr 12 12:59:36 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 331/1005] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 12:59:36 2023] DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments/5d5655e9-ab41-4361-a57b-817e42037463 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:36 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:36 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-96c696fb-a9c2-4d11-9172-18c4b3a586d8 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054826 Apr 12 12:59:36 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 337/1006] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 12:59:36 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:58 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:58 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-cb1a8d58-04c3-46fb-857f-5503f045bf64 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f/action" status: 202 len: 0 microversion: 2.87 time: 0.074830 Apr 12 12:59:58 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 339/1007] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 12:59:58 2023] POST /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=7 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:59:58 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 12:59:58 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f858174b-2497-49b0-aab4-c680edc6ba01 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1764 microversion: 2.87 time: 0.268270 Apr 12 12:59:58 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 332/1008] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 12:59:58 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1764 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-unplugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=5 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 12:59:59 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 12:59:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] Creating event network-vif-unplugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 12:59:59 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-9e0f056b-bf03-40c4-a1c0-c02e05ef99c0 req-51dcfe4b-737f-4504-a757-5762466db247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038345 Apr 12 12:59:59 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 338/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 12:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}, {"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:00:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:00:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d91aa903-5183-4383-8d4e-dd386c93e75a req-3424ce6d-8c2f-47cf-a395-771421c44eac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032878 Apr 12 13:00:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 340/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:00:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-b481a3af-810d-4778-84ee-f4cf5c1e0a4e req-25dc917d-4683-4fbd-bee1-7eb1dc147174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033689 Apr 12 13:00:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 333/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:07 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 HTTP/1.1 Apr 12 13:00:07 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:07 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:07 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:07 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:07 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:07 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:07 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:07 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:07 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:07 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:07 user devstack@n-api.service[61614]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:07 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:07 user devstack@n-api.service[61614]: method: > Apr 12 13:00:07 user devstack@n-api.service[61614]: exception: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:07 user devstack@n-api.service[61614]: action_args: {'id': '88c7dd97-0390-4b2b-b803-7ab023366fd4'} Apr 12 13:00:07 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:07 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-8b5bf426-e502-4a25-aada-ee1757e714b4 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 404 len: 111 microversion: 2.1 time: 0.032376 Apr 12 13:00:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 339/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:07 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:07 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3a9586a2-a33d-40b2-a2fd-37f794b75bbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '.version_select at 0x7fc95d24d2d0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:07 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3a9586a2-a33d-40b2-a2fd-37f794b75bbf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304891791" status: 202 len: 0 microversion: 2.1 time: 0.036344 Apr 12 13:00:07 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 341/1013] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 13:00:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304891791 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:10 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 HTTP/1.1 Apr 12 13:00:10 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:00:10 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:00:10 user devstack@n-api.service[61616]: Connection: close Apr 12 13:00:10 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:00:10 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:00:10 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:00:10 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:00:10 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:10 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:00:10 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:00:10 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:10 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:10 user devstack@n-api.service[61616]: method: > Apr 12 13:00:10 user devstack@n-api.service[61616]: exception: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61616]: action_args: {'id': '88c7dd97-0390-4b2b-b803-7ab023366fd4'} Apr 12 13:00:10 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5df12b74-9a94-441d-b34b-7c18dcb4c7cf tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 404 len: 111 microversion: 2.1 time: 0.044867 Apr 12 13:00:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 334/1014] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:10 2023] DELETE /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 88c7dd97-0390-4b2b-b803-7ab023366fd4] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:10 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 HTTP/1.1 Apr 12 13:00:10 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:10 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:10 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:10 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:10 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:10 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:10 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:10 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:10 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:10 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:10 user devstack@n-api.service[61614]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:10 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:10 user devstack@n-api.service[61614]: method: > Apr 12 13:00:10 user devstack@n-api.service[61614]: exception: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61614]: action_args: {'id': '88c7dd97-0390-4b2b-b803-7ab023366fd4'} Apr 12 13:00:10 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. Apr 12 13:00:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 88c7dd97-0390-4b2b-b803-7ab023366fd4 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3f2db163-e0f1-4b3f-8809-c89477e66707 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4" status: 404 len: 111 microversion: 2.1 time: 0.034250 Apr 12 13:00:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 340/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:10 2023] GET /compute/v2.1/servers/88c7dd97-0390-4b2b-b803-7ab023366fd4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:13 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded HTTP/1.1 Apr 12 13:00:13 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:13 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:13 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:13 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:13 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:13 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:13 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:13 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61615]: method: > Apr 12 13:00:13 user devstack@n-api.service[61615]: exception: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: action_args: {'id': '2647400c-e0e8-4fcb-9fa6-b4ab35197ded'} Apr 12 13:00:13 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-abd283d6-a953-4175-84ec-14262025f385 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 404 len: 111 microversion: 2.1 time: 0.042070 Apr 12 13:00:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 342/1016] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:13 2023] DELETE /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 2647400c-e0e8-4fcb-9fa6-b4ab35197ded] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:13 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded HTTP/1.1 Apr 12 13:00:13 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:00:13 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:00:13 user devstack@n-api.service[61616]: Connection: close Apr 12 13:00:13 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:00:13 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:00:13 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:00:13 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:00:13 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:13 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61616]: method: > Apr 12 13:00:13 user devstack@n-api.service[61616]: exception: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61616]: action_args: {'id': '2647400c-e0e8-4fcb-9fa6-b4ab35197ded'} Apr 12 13:00:13 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. Apr 12 13:00:13 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 2647400c-e0e8-4fcb-9fa6-b4ab35197ded could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:13 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-46b093ba-d7d2-4ab8-8de6-5384b2215973 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded" status: 404 len: 111 microversion: 2.1 time: 0.032383 Apr 12 13:00:13 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 335/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:13 2023] GET /compute/v2.1/servers/2647400c-e0e8-4fcb-9fa6-b4ab35197ded => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:13 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a HTTP/1.1 Apr 12 13:00:13 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:13 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:13 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:13 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:13 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:13 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:13 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:13 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61614]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:13 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61614]: method: > Apr 12 13:00:13 user devstack@n-api.service[61614]: exception: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61614]: action_args: {'id': 'c11aafa6-a6fa-44f2-8357-23d838a0b65a'} Apr 12 13:00:13 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:13 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0f8d4d9c-3e72-4aae-8766-4c580c9d9575 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 404 len: 111 microversion: 2.1 time: 0.031289 Apr 12 13:00:13 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 341/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:13 2023] DELETE /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: c11aafa6-a6fa-44f2-8357-23d838a0b65a] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:13 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a HTTP/1.1 Apr 12 13:00:13 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:13 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:13 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:13 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:13 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:13 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:13 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:13 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:13 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:13 user devstack@n-api.service[61615]: method: > Apr 12 13:00:13 user devstack@n-api.service[61615]: exception: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: action_args: {'id': 'c11aafa6-a6fa-44f2-8357-23d838a0b65a'} Apr 12 13:00:13 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. Apr 12 13:00:13 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance c11aafa6-a6fa-44f2-8357-23d838a0b65a could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0b49dff0-a56d-4162-b7c6-9aa502c912a2 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a" status: 404 len: 111 microversion: 2.1 time: 0.031352 Apr 12 13:00:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 343/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:13 2023] GET /compute/v2.1/servers/c11aafa6-a6fa-44f2-8357-23d838a0b65a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:15 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 HTTP/1.1 Apr 12 13:00:15 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:00:15 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:00:15 user devstack@n-api.service[61616]: Connection: close Apr 12 13:00:15 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:00:15 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:00:15 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:00:15 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:00:15 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:15 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:00:15 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:00:15 user devstack@n-api.service[61616]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:15 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:15 user devstack@n-api.service[61616]: method: > Apr 12 13:00:15 user devstack@n-api.service[61616]: exception: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61616]: action_args: {'id': '9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9'} Apr 12 13:00:15 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:15 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f4fc4104-41f4-48ae-a8a7-3da892d551d9 tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 404 len: 111 microversion: 2.1 time: 0.039731 Apr 12 13:00:15 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 336/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:15 2023] DELETE /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] [instance: 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] HTTP exception thrown: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Request method failure captured: Apr 12 13:00:15 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 HTTP/1.1 Apr 12 13:00:15 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:15 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:15 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:15 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:15 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:15 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:15 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:15 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqgPTh0N_c9qKAeL1mQO7qYq6ltN5-AJFOBbJHo7m9YMQQwatmfcFz2y9B1kHZouRWi4gvAQJg_lL8p-smCUUHu3QWdeR_3EoBMZSR6d7jvcGyv8xTpZkenl8nzozvWhZ7VwIKL3PyEWEvUGiRewtdBWjrqNk9WeXLuNS8jDF_KCCJQ Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Project-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e61975273ccb41229e0138b96eb7f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Tenant-Id: e61975273ccb41229e0138b96eb7f5e9 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-941338837 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:15 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:15 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:15 user devstack@n-api.service[61614]: X-User-Id: a3d9f4516bee4f8d9af7a40ed1298f03 Apr 12 13:00:15 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeNegativeTest-941338837-project-member Apr 12 13:00:15 user devstack@n-api.service[61614]: method: > Apr 12 13:00:15 user devstack@n-api.service[61614]: exception: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61614]: action_args: {'id': '9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9'} Apr 12 13:00:15 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. Apr 12 13:00:15 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:15 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] Returning 404 to user: Instance 9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:15 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5d10701c-5461-4c7a-b06d-28afbecf0daa tempest-AttachVolumeNegativeTest-941338837 tempest-AttachVolumeNegativeTest-941338837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9" status: 404 len: 111 microversion: 2.1 time: 0.036660 Apr 12 13:00:15 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 342/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:15 2023] GET /compute/v2.1/servers/9a1ea9e5-ab77-4d7c-bf9f-035b85e6b7a9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 13:00:19 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 HTTP/1.1 Apr 12 13:00:19 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:19 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:19 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:19 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:19 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:19 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:19 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:19 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:19 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:19 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:19 user devstack@n-api.service[61615]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 13:00:19 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:19 user devstack@n-api.service[61615]: method: > Apr 12 13:00:19 user devstack@n-api.service[61615]: exception: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:19 user devstack@n-api.service[61615]: action_args: {'id': '9ebf6f6b-3940-40fa-9a20-a28a957961e2'} Apr 12 13:00:19 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:19 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-4701b3ec-9844-4ad7-9edb-032c6a65b8a4 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 404 len: 111 microversion: 2.1 time: 0.030442 Apr 12 13:00:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 344/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:19 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5accdb92-17d2-43fc-9a55-d31f1ef5fa5f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '.version_select at 0x7fc95d268940>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:19 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5accdb92-17d2-43fc-9a55-d31f1ef5fa5f tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990566308" status: 202 len: 0 microversion: 2.1 time: 0.023691 Apr 12 13:00:19 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 337/1023] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 13:00:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990566308 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:00:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-f7c2324e-0fd4-446c-9780-dec999e7bdf1 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Action: 'create', calling method: .version_select at 0x7fc95d6695a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1867023859"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-f7c2324e-0fd4-446c-9780-dec999e7bdf1 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.668762 Apr 12 13:00:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 343/1024] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 13:00:19 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 670 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 13:00:20 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-52a83cae-7783-43ca-b0ca-d68e5a535ea7 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d2b6dd0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:20 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-52a83cae-7783-43ca-b0ca-d68e5a535ea7 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 200 len: 345 microversion: 2.1 time: 0.050155 Apr 12 13:00:20 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 345/1025] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:20 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-73bdb317-bd1c-479a-91e1-e9a891c82cf4 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95c134d30>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-73bdb317-bd1c-479a-91e1-e9a891c82cf4 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 200 len: 346 microversion: 2.1 time: 0.051238 Apr 12 13:00:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 338/1026] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:21 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:21 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-91e982f7-699d-455b-a5f6-cf2161b9ccb9 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Action: 'create', calling method: .version_select at 0x7fc95d078c10>, body: {"snapshot": {"volume_id": "1a62f2f7-c815-4464-bbd7-b3b57b9fe64b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1640644077"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-91e982f7-699d-455b-a5f6-cf2161b9ccb9 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153212 Apr 12 13:00:21 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 344/1027] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 13:00:21 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-073f8aac-21f1-4180-8235-4c926f48e924 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d24fb50>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-073f8aac-21f1-4180-8235-4c926f48e924 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.036178 Apr 12 13:00:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 346/1028] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:21 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 13:00:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-dfda39f6-0a62-468a-9537-a466482b061f tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d26ac20>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-dfda39f6-0a62-468a-9537-a466482b061f tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035255 Apr 12 13:00:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 339/1029] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 13:00:21 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:21 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-61710f1e-75e5-4944-89e5-9a56f15e49d4 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d1d5f30>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:21 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-61710f1e-75e5-4944-89e5-9a56f15e49d4 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.035471 Apr 12 13:00:21 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 345/1030] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:21 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:22 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-02c40f7d-d253-4467-b6b6-f5ae5d52314f tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d3b4f70>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-02c40f7d-d253-4467-b6b6-f5ae5d52314f tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.033980 Apr 12 13:00:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 347/1031] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:22 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:23 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-44bee929-8dac-420c-be49-1139f8438dcf tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95c1379a0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:23 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-44bee929-8dac-420c-be49-1139f8438dcf tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.035826 Apr 12 13:00:23 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 340/1032] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:23 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:24 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0fd3cf8a-6260-4232-bc82-efa5209abf77 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d137760>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:24 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0fd3cf8a-6260-4232-bc82-efa5209abf77 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 288 microversion: 2.1 time: 0.034286 Apr 12 13:00:24 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 346/1033] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:24 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:24 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5e72c669-6f8c-4a7a-b855-7efe7c00122b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d24e950>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:24 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5e72c669-6f8c-4a7a-b855-7efe7c00122b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 202 len: 0 microversion: 2.1 time: 0.062073 Apr 12 13:00:24 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 348/1034] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 13:00:24 2023] DELETE /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:00:24 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-c74fd6b2-0fb7-45b4-a47b-de06a9169c51 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d268f70>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:24 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-c74fd6b2-0fb7-45b4-a47b-de06a9169c51 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.036018 Apr 12 13:00:24 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 341/1035] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:24 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=10 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 13:00:25 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 HTTP/1.1 Apr 12 13:00:25 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:25 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:25 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:25 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:25 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:25 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:25 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:25 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:25 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:25 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:25 user devstack@n-api.service[61614]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 13:00:25 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:25 user devstack@n-api.service[61614]: method: > Apr 12 13:00:25 user devstack@n-api.service[61614]: exception: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61614]: action_args: {'id': '9ebf6f6b-3940-40fa-9a20-a28a957961e2'} Apr 12 13:00:25 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:25 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a46ae12b-8cc5-4938-a6ba-8508c7f7e198 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 404 len: 111 microversion: 2.1 time: 0.058072 Apr 12 13:00:25 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 347/1036] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:25 2023] DELETE /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: 9ebf6f6b-3940-40fa-9a20-a28a957961e2] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:25 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 13:00:25 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 HTTP/1.1 Apr 12 13:00:25 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:25 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:25 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:25 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:25 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:25 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:25 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:25 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:25 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:25 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:25 user devstack@n-api.service[61615]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 13:00:25 user devstack@n-api.service[61615]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:25 user devstack@n-api.service[61615]: method: > Apr 12 13:00:25 user devstack@n-api.service[61615]: exception: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61615]: action_args: {'id': '9ebf6f6b-3940-40fa-9a20-a28a957961e2'} Apr 12 13:00:25 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. Apr 12 13:00:25 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:25 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance 9ebf6f6b-3940-40fa-9a20-a28a957961e2 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:25 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-bdccda99-bc5b-4383-bf4a-2e3e15ca6ec8 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2" status: 404 len: 111 microversion: 2.1 time: 0.038955 Apr 12 13:00:25 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 349/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:25 2023] GET /compute/v2.1/servers/9ebf6f6b-3940-40fa-9a20-a28a957961e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:25 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=14 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:26 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1930103e-34b5-4216-affe-c0cf64a9bdbc tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95c136ef0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:26 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1930103e-34b5-4216-affe-c0cf64a9bdbc tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.054174 Apr 12 13:00:26 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 342/1038] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:25 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:26 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:26 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-635cd6f9-cd37-4319-b4ec-45253a40b1df tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076557 Apr 12 13:00:26 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 348/1039] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 13:00:26 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:26 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HTTP exception thrown: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 is not attached to volume 5d5655e9-ab41-4361-a57b-817e42037463 Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Request method failure captured: Apr 12 13:00:26 user devstack@n-api.service[61615]: request: DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments/5d5655e9-ab41-4361-a57b-817e42037463 HTTP/1.1 Apr 12 13:00:26 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:26 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:26 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:26 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:26 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:26 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:26 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:26 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqjngHT4XSykoNJfeFU03ov7-3UXEphY4ah4u09nQcuJOpk_OxNgL-8coelFN-4JA6cgEAyttxv-I-KnQc1lO41AuHm3zCtypZvqX5tUyWea7h6xrMSTK9s76i3_0RJ7XDnByAriKaA0T__fjtwq9OV8Ml0bZ6CG3U6fEQ2gnm7KvrE Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Project-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Tenant: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Tenant-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-User: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 13:00:26 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:26 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:26 user devstack@n-api.service[61615]: X-User-Id: 924c3a968d734a1c9ddfc5a44d8f6352 Apr 12 13:00:26 user devstack@n-api.service[61615]: X-User-Name: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 13:00:26 user devstack@n-api.service[61615]: method: > Apr 12 13:00:26 user devstack@n-api.service[61615]: exception: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 is not attached to volume 5d5655e9-ab41-4361-a57b-817e42037463 Apr 12 13:00:26 user devstack@n-api.service[61615]: action_args: {'server_id': 'a73a4b87-a9a8-4b01-af1f-4b2a64554b54', 'id': '5d5655e9-ab41-4361-a57b-817e42037463'} Apr 12 13:00:26 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5d5655e9-ab41-4361-a57b-817e42037463. Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 is not attached to volume 5d5655e9-ab41-4361-a57b-817e42037463 Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 is not attached to volume 5d5655e9-ab41-4361-a57b-817e42037463 Apr 12 13:00:26 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:26 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Returning 404 to user: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 is not attached to volume 5d5655e9-ab41-4361-a57b-817e42037463 {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:26 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-8269663f-268a-4f30-8609-a0c104e3c8d2 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments/5d5655e9-ab41-4361-a57b-817e42037463" status: 404 len: 154 microversion: 2.1 time: 0.187943 Apr 12 13:00:26 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 350/1040] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 13:00:26 2023] DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54/os-volume_attachments/5d5655e9-ab41-4361-a57b-817e42037463 => generated 154 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:27 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-755ea199-0f3f-47c0-875f-b040e2f52a71 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d6684c0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:27 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-755ea199-0f3f-47c0-875f-b040e2f52a71 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 200 len: 287 microversion: 2.1 time: 0.040150 Apr 12 13:00:27 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 343/1041] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:27 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6ca3227d-6f5c-4b3f-bb9f-3fbf40066245 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d3ec670>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-6ca3227d-6f5c-4b3f-bb9f-3fbf40066245 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] HTTP exception thrown: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6ca3227d-6f5c-4b3f-bb9f-3fbf40066245 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Request method failure captured: Apr 12 13:00:28 user devstack@n-api.service[61614]: request: GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 HTTP/1.1 Apr 12 13:00:28 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:28 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:28 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:28 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:28 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:28 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:28 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:28 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqtjGo3XWCf2n5IyBlLj4P9J2ts3N7E3GKaYMz2wncPd8rM4xH1a1YFSDfIQL9KDOayir83VzOanqId2mrIQLFHaoimDFdmWIDiSQ7QBl3jUssVV0MrGC9CuuJZ9KhDV7ApV1MkywFN4cbNc9B0qv_rBjHGaIMDuHbHMhndOvxyFkRA Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Id: e412d253664b42df98210de67e90e009 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:28 user devstack@n-api.service[61614]: method: Apr 12 13:00:28 user devstack@n-api.service[61614]: exception: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: action_args: {'id': 'bb71420e-a656-4700-a79e-032a074dc565'} Apr 12 13:00:28 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. (HTTP 404) (Request-ID: req-74246ee8-c80b-4272-9fa5-ebf987ad77d1) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6ca3227d-6f5c-4b3f-bb9f-3fbf40066245 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Returning 404 to user: Snapshot bb71420e-a656-4700-a79e-032a074dc565 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6ca3227d-6f5c-4b3f-bb9f-3fbf40066245 tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565" status: 404 len: 111 microversion: 2.1 time: 0.053013 Apr 12 13:00:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 349/1042] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 13:00:28 2023] GET /compute/v2.1/os-snapshots/bb71420e-a656-4700-a79e-032a074dc565 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:28 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-f6902b62-ad0b-4f94-acab-1b15dcac8e3d tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d24c5e0>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 13:00:28 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 HTTP/1.1 Apr 12 13:00:28 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:00:28 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:00:28 user devstack@n-api.service[61616]: Connection: close Apr 12 13:00:28 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:00:28 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:00:28 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:00:28 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:00:28 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:28 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61616]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 13:00:28 user devstack@n-api.service[61616]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:28 user devstack@n-api.service[61616]: method: > Apr 12 13:00:28 user devstack@n-api.service[61616]: exception: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61616]: action_args: {'id': 'db9f1454-9e3c-40d4-849b-c13537d6be97'} Apr 12 13:00:28 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-e7b73731-6eef-4b15-8b0d-02241db25b31 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 404 len: 111 microversion: 2.1 time: 0.031832 Apr 12 13:00:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 344/1043] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:28 2023] DELETE /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] [instance: db9f1454-9e3c-40d4-849b-c13537d6be97] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] HTTP exception thrown: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Request method failure captured: Apr 12 13:00:28 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 HTTP/1.1 Apr 12 13:00:28 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:28 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:28 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:28 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:28 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:28 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:28 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:28 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqg7gRRdu5ubqbThKu25K8FF9F06ZrILzQE0WszZSSb3gbGjNdsNYbxn5F-CjLV7FKBPcbx9tMunqrypu3h33-YR5vCxXEnHeobJ_8AxruX6QgA7TNLt3WS61R4pqR4HNi9MewQ6fCmDBuLfjavyb4DaoKOi8HoZCoely8NtomSUG7Q Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Project-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0e6aaaa9a634f349d371f7c6c15eca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant-Id: a0e6aaaa9a634f349d371f7c6c15eca2 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905742219 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Id: 8a9c54033c7547c2bae91e6c1dba0976 Apr 12 13:00:28 user devstack@n-api.service[61614]: X-User-Name: tempest-AttachVolumeTestJSON-905742219-project-member Apr 12 13:00:28 user devstack@n-api.service[61614]: method: > Apr 12 13:00:28 user devstack@n-api.service[61614]: exception: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: action_args: {'id': 'db9f1454-9e3c-40d4-849b-c13537d6be97'} Apr 12 13:00:28 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. Apr 12 13:00:28 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:28 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] Returning 404 to user: Instance db9f1454-9e3c-40d4-849b-c13537d6be97 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:28 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-4d1f24a7-24d2-4825-9b3c-0c8e6b06df04 tempest-AttachVolumeTestJSON-905742219 tempest-AttachVolumeTestJSON-905742219-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97" status: 404 len: 111 microversion: 2.1 time: 0.028968 Apr 12 13:00:28 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 350/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:28 2023] GET /compute/v2.1/servers/db9f1454-9e3c-40d4-849b-c13537d6be97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:28 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-f6902b62-ad0b-4f94-acab-1b15dcac8e3d tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 202 len: 0 microversion: 2.1 time: 0.088673 Apr 12 13:00:28 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 351/1045] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 13:00:28 2023] DELETE /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:00:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-ed80c504-0768-4901-8536-b1ef5c6a369d tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d201fc0>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-ed80c504-0768-4901-8536-b1ef5c6a369d tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 200 len: 345 microversion: 2.1 time: 0.058419 Apr 12 13:00:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 345/1046] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:28 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fdf74428-3ec2-4c4a-b788-60fe6ac4e39c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d135ea0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fdf74428-3ec2-4c4a-b788-60fe6ac4e39c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 200 len: 345 microversion: 2.1 time: 0.066127 Apr 12 13:00:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 351/1047] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:29 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-92bcc21f-e0fe-4362-8fcc-91fe6aa2802c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d181c60>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-92bcc21f-e0fe-4362-8fcc-91fe6aa2802c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] HTTP exception thrown: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-92bcc21f-e0fe-4362-8fcc-91fe6aa2802c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Request method failure captured: Apr 12 13:00:30 user devstack@n-api.service[61615]: request: GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b HTTP/1.1 Apr 12 13:00:30 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:00:30 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:00:30 user devstack@n-api.service[61615]: Connection: close Apr 12 13:00:30 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:00:30 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:00:30 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:00:30 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:00:30 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqtjGo3XWCf2n5IyBlLj4P9J2ts3N7E3GKaYMz2wncPd8rM4xH1a1YFSDfIQL9KDOayir83VzOanqId2mrIQLFHaoimDFdmWIDiSQ7QBl3jUssVV0MrGC9CuuJZ9KhDV7ApV1MkywFN4cbNc9B0qv_rBjHGaIMDuHbHMhndOvxyFkRA Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Project-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Tenant-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-User: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61615]: X-User-Id: e412d253664b42df98210de67e90e009 Apr 12 13:00:30 user devstack@n-api.service[61615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61615]: method: Apr 12 13:00:30 user devstack@n-api.service[61615]: exception: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61615]: action_args: {'id': '1a62f2f7-c815-4464-bbd7-b3b57b9fe64b'} Apr 12 13:00:30 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. (HTTP 404) (Request-ID: req-11fbd70b-0ada-4877-95ee-7ae41f4f53f1) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-92bcc21f-e0fe-4362-8fcc-91fe6aa2802c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Returning 404 to user: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:30 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-92bcc21f-e0fe-4362-8fcc-91fe6aa2802c tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 404 len: 109 microversion: 2.1 time: 0.049500 Apr 12 13:00:30 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 352/1048] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:30 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2a0fe620-fbcb-4128-a1de-2e6e9e06baeb tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d505990>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-2a0fe620-fbcb-4128-a1de-2e6e9e06baeb tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] HTTP exception thrown: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2a0fe620-fbcb-4128-a1de-2e6e9e06baeb tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Request method failure captured: Apr 12 13:00:30 user devstack@n-api.service[61616]: request: DELETE /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b HTTP/1.1 Apr 12 13:00:30 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:00:30 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:00:30 user devstack@n-api.service[61616]: Connection: close Apr 12 13:00:30 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:00:30 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:00:30 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:00:30 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:00:30 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqtjGo3XWCf2n5IyBlLj4P9J2ts3N7E3GKaYMz2wncPd8rM4xH1a1YFSDfIQL9KDOayir83VzOanqId2mrIQLFHaoimDFdmWIDiSQ7QBl3jUssVV0MrGC9CuuJZ9KhDV7ApV1MkywFN4cbNc9B0qv_rBjHGaIMDuHbHMhndOvxyFkRA Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Project-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Tenant-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-User: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61616]: X-User-Id: e412d253664b42df98210de67e90e009 Apr 12 13:00:30 user devstack@n-api.service[61616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61616]: method: Apr 12 13:00:30 user devstack@n-api.service[61616]: exception: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61616]: action_args: {'id': '1a62f2f7-c815-4464-bbd7-b3b57b9fe64b'} Apr 12 13:00:30 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. (HTTP 404) (Request-ID: req-d94c32f6-9fda-4e21-a23f-88de014d7905) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2a0fe620-fbcb-4128-a1de-2e6e9e06baeb tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Returning 404 to user: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:30 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2a0fe620-fbcb-4128-a1de-2e6e9e06baeb tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 404 len: 109 microversion: 2.1 time: 0.046367 Apr 12 13:00:30 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 346/1049] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 13:00:30 2023] DELETE /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0cdff11a-b941-4280-bd22-c1e224c7503b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Calling method '.version_select at 0x7fc95d668dc0>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-0cdff11a-b941-4280-bd22-c1e224c7503b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] HTTP exception thrown: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0cdff11a-b941-4280-bd22-c1e224c7503b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Request method failure captured: Apr 12 13:00:30 user devstack@n-api.service[61614]: request: GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b HTTP/1.1 Apr 12 13:00:30 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:00:30 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:00:30 user devstack@n-api.service[61614]: Connection: close Apr 12 13:00:30 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:00:30 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:00:30 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:00:30 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:00:30 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqtjGo3XWCf2n5IyBlLj4P9J2ts3N7E3GKaYMz2wncPd8rM4xH1a1YFSDfIQL9KDOayir83VzOanqId2mrIQLFHaoimDFdmWIDiSQ7QBl3jUssVV0MrGC9CuuJZ9KhDV7ApV1MkywFN4cbNc9B0qv_rBjHGaIMDuHbHMhndOvxyFkRA Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Project-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9c3073b677dd4dddb30e56abb27b5ff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Tenant-Id: 9c3073b677dd4dddb30e56abb27b5ff2 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-614264074 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-User: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:00:30 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:00:30 user devstack@n-api.service[61614]: X-User-Id: e412d253664b42df98210de67e90e009 Apr 12 13:00:30 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-614264074-project-member Apr 12 13:00:30 user devstack@n-api.service[61614]: method: Apr 12 13:00:30 user devstack@n-api.service[61614]: exception: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61614]: action_args: {'id': '1a62f2f7-c815-4464-bbd7-b3b57b9fe64b'} Apr 12 13:00:30 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. (HTTP 404) (Request-ID: req-e0791ba7-7e84-45d7-8646-134bbd30acec) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. Apr 12 13:00:30 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:00:30 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-0cdff11a-b941-4280-bd22-c1e224c7503b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] Returning 404 to user: Volume 1a62f2f7-c815-4464-bbd7-b3b57b9fe64b could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:00:30 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-0cdff11a-b941-4280-bd22-c1e224c7503b tempest-VolumesSnapshotsTestJSON-614264074 tempest-VolumesSnapshotsTestJSON-614264074-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b" status: 404 len: 109 microversion: 2.1 time: 0.040484 Apr 12 13:00:30 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 352/1050] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:00:30 2023] GET /compute/v2.1/os-volumes/1a62f2f7-c815-4464-bbd7-b3b57b9fe64b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:31 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:00:31 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1ad415e2-4c83-4278-9676-18d76d1622f4 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 204 len: 0 microversion: 2.1 time: 0.110466 Apr 12 13:00:31 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 353/1051] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:00:30 2023] DELETE /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:31 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '924c3a968d734a1c9ddfc5a44d8f6352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f411f36f23e464fa4a395ad6b2b4472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:00:31 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-1df9e9cd-2067-4158-bef0-bd852e3c01c9 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 200 len: 1542 microversion: 2.1 time: 0.247838 Apr 12 13:00:31 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 347/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:00:31 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 1542 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:00:31 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-unplugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:31 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] Creating event network-vif-unplugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 13:00:31 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-e9747f61-0c0f-4e51-8ad6-0c8f6927127a req-2d62c821-f115-4f05-8465-4a137fe89bfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035561 Apr 12 13:00:31 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 353/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:32 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-deleted", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:32 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] Creating event network-vif-deleted:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 13:00:32 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-4839fd6e-dbc1-4972-a826-977423808e60 req-b08f41ba-90ca-4baa-a302-0b012415da5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140468 Apr 12 13:00:32 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 354/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:33 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73a4b87-a9a8-4b01-af1f-4b2a64554b54", "name": "network-vif-plugged", "status": "completed", "tag": "7103abd2-88c5-437a-9661-64ca6379a130"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:33 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] Creating event network-vif-plugged:7103abd2-88c5-437a-9661-64ca6379a130 for instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 on user Apr 12 13:00:33 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-da89f338-e904-49a5-a52e-2a9c48f301ec req-5e73fc5a-e93a-4770-941e-80d2e978836e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Apr 12 13:00:33 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 348/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:00:48 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:00:49 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:00:49 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:00:49 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:00:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-3d4756d7-03a4-4eb7-b012-3ff50565d202 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1770 microversion: 2.87 time: 0.232481 Apr 12 13:00:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 354/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:00:48 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1770 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:00:56 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:56 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:56 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-947f5dd0-8787-483b-a9e5-0a1ad56f7056 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'create', calling method: .version_select at 0x7fc95d24e8c0>, body: {"keypair": {"name": "tempest-TestStampPattern-193639278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/5v3eCbyqn1cBjTbTlpYaNU+pu9bnoXsJrgMiEn/z8xxIi9MkvXpvfk3KhnFx+XRfpoIpI1zKXf4THCFNpnfEDB0Wv8SQLcFxbpIn7/+LQHs5b/5vFRKuB/DiXoVA+A=="}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:56 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-947f5dd0-8787-483b-a9e5-0a1ad56f7056 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for project f51e624010914d7680080956cbb0c720. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:00:56 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-947f5dd0-8787-483b-a9e5-0a1ad56f7056 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for user bc5b75e437444fe4a54c1516964f0cfa and project f51e624010914d7680080956cbb0c720. Resources: {'key_pairs'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:00:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-947f5dd0-8787-483b-a9e5-0a1ad56f7056 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.304242 Apr 12 13:00:56 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 355/1057] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 13:00:56 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:00:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=10 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:00:59 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-335893625", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "key_name": "tempest-TestStampPattern-193639278", "security_groups": [{"name": "tempest-secgroup-smoke-651165355"}], "networks": [{"uuid": "f7ac30df-76aa-400e-868d-9ad902bd9446"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:00:59 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] validate_networks() for [('f7ac30df-76aa-400e-868d-9ad902bd9446', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for project f51e624010914d7680080956cbb0c720. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for user bc5b75e437444fe4a54c1516964f0cfa and project f51e624010914d7680080956cbb0c720. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 13:01:00 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 13:01:00 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-5ec29ac8-44af-43b5-ace4-b67cbbe86faf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.678114 Apr 12 13:01:00 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 349/1058] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 13:00:59 2023] POST /compute/v2.1/servers => generated 403 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 13:01:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c6b2d49a-26e2-4456-9cb9-5e129402224f tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:01:00 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c6b2d49a-26e2-4456-9cb9-5e129402224f tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:01:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:00 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c6b2d49a-26e2-4456-9cb9-5e129402224f tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:01:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c6b2d49a-26e2-4456-9cb9-5e129402224f tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 200 len: 1235 microversion: 2.1 time: 0.083158 Apr 12 13:01:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 355/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:01:00 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:01:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] Creating event network-changed:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:01:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d9a35ceb-d029-475f-9cc9-77371acad84a req-16528f63-3c0d-4050-8a72-91c3a9d595c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028102 Apr 12 13:01:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 356/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:01:05 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:05 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] Creating event network-vif-plugged:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:01:05 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-dfe94422-ac2e-49d7-8280-028d0017ff25 req-9f717bc2-57bc-4d95-b6d8-17931d786518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Apr 12 13:01:05 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 350/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:01:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] Creating event network-vif-plugged:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:01:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-3402a939-9ccb-4aca-a01a-b0f3028d84ed req-9c1f4452-bd74-431c-9a3a-1f87e0f14c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031132 Apr 12 13:01:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 356/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] [instance: a73a4b87-a9a8-4b01-af1f-4b2a64554b54] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] HTTP exception thrown: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Request method failure captured: Apr 12 13:01:21 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 HTTP/1.1 Apr 12 13:01:21 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:01:21 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:01:21 user devstack@n-api.service[61615]: Connection: close Apr 12 13:01:21 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:01:21 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:01:21 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:01:21 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:01:21 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNqjngHT4XSykoNJfeFU03ov7-3UXEphY4ah4u09nQcuJOpk_OxNgL-8coelFN-4JA6cgEAyttxv-I-KnQc1lO41AuHm3zCtypZvqX5tUyWea7h6xrMSTK9s76i3_0RJ7XDnByAriKaA0T__fjtwq9OV8Ml0bZ6CG3U6fEQ2gnm7KvrE Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Project-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2f411f36f23e464fa4a395ad6b2b4472"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Tenant: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Tenant-Id: 2f411f36f23e464fa4a395ad6b2b4472 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381334085 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-User: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 13:01:21 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:01:21 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:01:21 user devstack@n-api.service[61615]: X-User-Id: 924c3a968d734a1c9ddfc5a44d8f6352 Apr 12 13:01:21 user devstack@n-api.service[61615]: X-User-Name: tempest-TestMinimumBasicScenario-381334085-project-member Apr 12 13:01:21 user devstack@n-api.service[61615]: method: > Apr 12 13:01:21 user devstack@n-api.service[61615]: exception: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. Apr 12 13:01:21 user devstack@n-api.service[61615]: action_args: {'id': 'a73a4b87-a9a8-4b01-af1f-4b2a64554b54'} Apr 12 13:01:21 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. Apr 12 13:01:21 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:01:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Returning 404 to user: Instance a73a4b87-a9a8-4b01-af1f-4b2a64554b54 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:01:21 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2a5c66b5-9deb-4be4-803f-8c7607eef227 tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54" status: 404 len: 111 microversion: 2.1 time: 0.272230 Apr 12 13:01:21 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 357/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:01:21 2023] GET /compute/v2.1/servers/a73a4b87-a9a8-4b01-af1f-4b2a64554b54 => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:01:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:21 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9172ad35-45a4-4c16-9214-f454260fe54e tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] Calling method '.version_select at 0x7fc95c137880>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:01:21 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9172ad35-45a4-4c16-9214-f454260fe54e tempest-TestMinimumBasicScenario-381334085 tempest-TestMinimumBasicScenario-381334085-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1710707159" status: 202 len: 0 microversion: 2.1 time: 0.068358 Apr 12 13:01:21 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 351/1064] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 13:01:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1710707159 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-339222954", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "bb52f82e-56ca-41f7-b171-a3cacb549ef5"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] validate_networks() for [('bb52f82e-56ca-41f7-b171-a3cacb549ef5', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for user 435e0d6fd2b3437f837e82730b4d955f and project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 13:01:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 13:01:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-edb54ec3-dc6f-456d-ba5e-7c4f1a3c3cb9 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.578737 Apr 12 13:01:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 357/1065] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 13:01:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 13:01:49 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:01:49 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:01:49 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:49 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:50 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:01:50 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:01:50 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:01:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-03d9fb22-321e-4411-8f19-56d68a95ce6f tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 200 len: 1394 microversion: 2.87 time: 0.077336 Apr 12 13:01:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 358/1066] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:01:49 2023] GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 1394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:50 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:01:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9fe883f6-ebd1-44c0-946c-7d54f57c7683 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 200 len: 1536 microversion: 2.1 time: 0.197862 Apr 12 13:01:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 352/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:01:50 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 1536 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:01:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] Creating event network-changed:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:01:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-a15fc3ea-8c77-4117-983f-bcefe9a7aa88 req-c5b6b8d7-e0c5-4125-92d6-1144bdec4ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036912 Apr 12 13:01:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 358/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:01:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "name": "network-vif-plugged", "status": "completed", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] Creating event network-vif-plugged:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:01:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d317d8bd-1cfb-4694-9a1e-abb48875383d req-eccc1fc5-6292-4728-981c-9054d1d1fb05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 Apr 12 13:01:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 359/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:01:56 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "name": "network-vif-plugged", "status": "completed", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:01:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:01:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:01:56 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:01:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] Creating event network-vif-plugged:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:01:56 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-24d23e44-95e6-4392-82ab-b8f1e6cf6d30 req-ff6d8ac3-7921-42c5-b8b8-b3dc0300a152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075316 Apr 12 13:01:56 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 353/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:02:40 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:02:40 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-a537a2d0-22b4-4cf0-9512-02441f28dd9a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 200 len: 1691 microversion: 2.87 time: 0.173266 Apr 12 13:02:40 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 359/1071] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:02:40 2023] GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:50 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:02:50 user devstack@n-api.service[61615]: Wed Apr 12 13:02:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 (ip 10.0.0.210) !!! Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:50 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:02:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3db91424-482c-42d5-a8c6-409486c9a089 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 200 len: 1536 microversion: 2.1 time: 0.159180 Apr 12 13:02:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 360/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:02:50 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 1536 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] Creating event network-changed:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:02:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-a2efd56b-87c9-4a05-ab9f-0d4f7b957ee8 req-1c23833f-5240-4c8f-820f-61dd1d9d583b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Apr 12 13:02:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 354/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:02:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c6757bb-c886-4df6-a70f-abdf3f611979"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:02:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:02:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1583f82f-1ba9-4203-9d8f-5039d7e01825 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314625 Apr 12 13:02:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 360/1074] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 13:02:53 2023] POST /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:01 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'services' on Instance uuid e47cf07b-9759-4350-9e10-bd5bb15678f3 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 13:03:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-47ee3b5f-2159-473e-bb50-562e94fbddfd tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979" status: 202 len: 0 microversion: 2.1 time: 0.183095 Apr 12 13:03:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 361/1075] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 13:03:01 2023] DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a5bfc943-8cc8-454a-bdd2-a8101d1de43c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049987 Apr 12 13:03:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 355/1076] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 13:03:01 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1783586544"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:40 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-00a68046-7671-4168-b741-37d75ed4088a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e/action" status: 202 len: 52 microversion: 2.87 time: 0.844539 Apr 12 13:03:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 361/1077] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 13:03:40 2023] POST /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e/action => generated 52 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:03:46 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:03:46 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-80073d17-ea4d-4469-b8b5-b57d4ade4181 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 200 len: 1691 microversion: 2.87 time: 0.171334 Apr 12 13:03:46 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 362/1078] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:03:46 2023] GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-8bee59a4-b86e-46b6-b576-47e87146cc18 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048204 Apr 12 13:03:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 356/1079] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 13:03:51 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1782159827"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:03:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:03:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-82e3e6ba-32ea-423a-b1d8-5d90520f445e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/action" status: 202 len: 0 microversion: 2.1 time: 0.751119 Apr 12 13:03:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 362/1080] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 13:03:54 2023] POST /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 13:04:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-469200579", "imageRef": "f809e75f-4f4b-4f31-abc7-1036ed53155c", "flavorRef": "42", "key_name": "tempest-TestStampPattern-193639278", "security_groups": [{"name": "tempest-secgroup-smoke-651165355"}], "networks": [{"uuid": "f7ac30df-76aa-400e-868d-9ad902bd9446"}]}} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.network.neutron [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] validate_networks() for [('f7ac30df-76aa-400e-868d-9ad902bd9446', None, None, None, None, None)] {{(pid=61615) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image limits 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Flavor pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Image pref 0:0:0 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.virt.hardware [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for project f51e624010914d7680080956cbb0c720. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.quota [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Getting quotas for user bc5b75e437444fe4a54c1516964f0cfa and project f51e624010914d7680080956cbb0c720. Resources: {'cores', 'ram', 'instances'} {{(pid=61615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Going to run 1 instances... {{(pid=61615) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 13:04:03 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f809e75f-4f4b-4f31-abc7-1036ed53155c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 13:04:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-ab7e64cc-8b3b-46b5-880c-1c687c428555 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.632297 Apr 12 13:04:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 363/1081] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 13:04:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 13:04:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-338db726-59f5-45ff-b1d4-735337bf2ecf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:04:03 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-338db726-59f5-45ff-b1d4-735337bf2ecf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:04:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:03 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:03 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-338db726-59f5-45ff-b1d4-735337bf2ecf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:04:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-338db726-59f5-45ff-b1d4-735337bf2ecf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 200 len: 1235 microversion: 2.1 time: 0.183738 Apr 12 13:04:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 357/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:04:03 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 1235 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:06 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] Creating event network-changed:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:04:06 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-622810fd-f7cd-4ef3-9600-648299df4034 req-210516fd-c1b8-4526-ad26-ec08f4896a3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039889 Apr 12 13:04:06 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 363/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:04:08 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-plugged", "status": "completed", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:08 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] Creating event network-vif-plugged:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:04:08 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-266ed292-d0d3-4faf-a361-44835f4e6842 req-3f5e70c6-4642-4782-adf7-4c57a61befbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084426 Apr 12 13:04:08 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 364/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:04:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-plugged", "status": "completed", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] Creating event network-vif-plugged:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:04:10 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-5ad04bbb-44f8-413e-b267-e21a8299da6b req-e7178420-9b41-464a-a3fb-ea09b11e152b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029467 Apr 12 13:04:10 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 358/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:04:46 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:46 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:46 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1366095873", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "destination_type": "volume"}], "networks": [{"uuid": "bb52f82e-56ca-41f7-b171-a3cacb549ef5"}]}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:46 user devstack@n-api.service[61614]: DEBUG nova.network.neutron [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] validate_networks() for [('bb52f82e-56ca-41f7-b171-a3cacb549ef5', None, None, None, None, None)] {{(pid=61614) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image limits 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Flavor pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Image pref 0:0:0 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.virt.hardware [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.quota [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Getting quotas for user 435e0d6fd2b3437f837e82730b4d955f and project f20ad21427a04683b9b102d2ff0290a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Going to run 1 instances... {{(pid=61614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 13:04:47 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 13:04:47 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-b5eb3278-cc82-4bb2-993e-11d4d6f41f99 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.619239 Apr 12 13:04:47 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 364/1086] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 13:04:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:04:47 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:04:47 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-0a428898-2865-4634-8b0b-8418b1a7b5ea tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1395 microversion: 2.87 time: 0.137869 Apr 12 13:04:47 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 365/1087] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:04:47 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1395 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:49 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] Creating event network-changed:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:04:49 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-04605c8f-1542-43e8-9cf5-d39a94238e15 req-b7cf7231-2f8e-428b-b3c0-8fba26a27dec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039947 Apr 12 13:04:49 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 359/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:04:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:04:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:04:54 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:04:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-7cb2fee6-767e-40d7-85b2-483dcc0a9741 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 200 len: 1536 microversion: 2.1 time: 0.171806 Apr 12 13:04:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 365/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:04:53 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 1536 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:05:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-b46a7b89-009b-49b0-b32c-d7030c9e31cc req-e8405afd-671e-4065-a9ea-109ecd0d516f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084562 Apr 12 13:05:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 366/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:05:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:05:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:05:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-d3337608-c0be-42c4-85b6-8dff67823352 req-bcce8bdd-a272-4b2b-b3bf-f3be323e8202 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251777 Apr 12 13:05:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 360/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell0:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:05:37 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:05:37 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-1c900dac-eeef-4378-9143-f05634619f03 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1769 microversion: 2.87 time: 0.245554 Apr 12 13:05:37 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 366/1092] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:05:37 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1769 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:54 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:05:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-34b0ecc2-b52a-4e0c-8972-64ef1f6defa4 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 200 len: 1536 microversion: 2.1 time: 0.179960 Apr 12 13:05:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:05:54 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 1536 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:05:55 user devstack@n-api.service[61616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:05:55 user devstack@n-api.service[61616]: Wed Apr 12 13:05:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 13:05:55 user devstack@n-api.service[61616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:05:55 user devstack@n-api.service[61616]: Wed Apr 12 13:05:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:55 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] Creating event network-changed:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:05:55 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-89a4a9e7-c959-4493-a586-8507db0ba179 req-86a60f4f-b08c-416e-8e6a-b58b21099985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110797 Apr 12 13:05:55 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 361/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "951427af-91f8-4372-b076-f1f3998ccff0"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:05:55 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:05:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-90047315-defc-4863-8bea-0c9d5eb03751 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292068 Apr 12 13:05:56 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 367/1095] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 13:05:55 2023] POST /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:03 user devstack@n-api.service[61615]: DEBUG nova.objects.instance [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lazy-loading 'services' on Instance uuid 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 {{(pid=61615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 13:06:03 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-779983a0-200f-4a35-9e3a-12aeec0c2199 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments/951427af-91f8-4372-b076-f1f3998ccff0" status: 202 len: 0 microversion: 2.1 time: 0.171885 Apr 12 13:06:03 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 368/1096] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 13:06:03 2023] DELETE /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments/951427af-91f8-4372-b076-f1f3998ccff0 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:03 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:03 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-9d4d94f9-c490-4c8a-a465-c87e9f22ab41 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059774 Apr 12 13:06:03 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 362/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 13:06:03 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "29f26fe8-ee5c-401f-be18-735ba4a5665d"}} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:38 user devstack@n-api.service[61614]: DEBUG nova.objects.instance [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lazy-loading 'flavor' on Instance uuid d1820783-afa6-434c-9da4-09d9c4990fa1 {{(pid=61614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 13:06:38 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-e0f2be0c-bcb1-407c-95c1-923778a95c39 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1/action" status: 200 len: 29 microversion: 2.87 time: 0.331845 Apr 12 13:06:38 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 368/1098] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 13:06:38 2023] POST /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1/action => generated 29 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:06:38 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:06:38 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-b822c935-9d5d-4433-b0ca-0005bf2c861b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1775 microversion: 2.87 time: 0.211519 Apr 12 13:06:38 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 369/1099] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:06:38 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1775 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:39 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] Creating event network-vif-unplugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:06:39 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-3d3e0539-1df2-431b-8ee1-22dbe3832f65 req-86864e69-360a-4636-82a5-88a5b77b1eab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038075 Apr 12 13:06:39 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 363/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:41 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:41 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:06:41 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-c36205bb-1244-413a-964c-1b39c146436d req-6b14a158-188f-4c67-a486-184d38d4268d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 Apr 12 13:06:41 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 369/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:43 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:43 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:06:43 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-d6f59256-9c47-489e-bf91-6a1d8e727a70 req-afba8b3f-c0df-45a1-aa46-a8b1982d3d29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 Apr 12 13:06:43 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 370/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:45 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:45 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:06:45 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-91b4ed2e-9274-4bba-ba12-e4e787f3be88 req-ea168d95-754d-4735-bd95-6d7f2751b2c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Apr 12 13:06:45 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 364/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:53 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:53 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6e5a1c49-9c38-45d6-a4ce-5d71d9c1e35c tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051664 Apr 12 13:06:53 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 370/1104] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 13:06:53 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=8 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:06:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] Creating event network-changed:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:06:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-9d309892-9058-4692-99d8-d30f4aefadf1 req-92856e83-06b6-4ecf-aa6e-33bb10f8299f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068783 Apr 12 13:06:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 365/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-3f31e1d7-ffe0-44b1-9a87-03578a79b2e3 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 204 len: 0 microversion: 2.1 time: 0.146409 Apr 12 13:06:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 371/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:06:54 2023] DELETE /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:06:54 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-9a7cbedc-a195-4dff-84d8-8be0b08994f5 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 200 len: 1660 microversion: 2.1 time: 0.284723 Apr 12 13:06:54 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 371/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:06:54 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 1660 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-unplugged", "status": "completed", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:54 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] Creating event network-vif-unplugged:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:06:54 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-957cefdd-3f16-4d3e-8e37-c65a91827fc1 req-87112289-2b0a-4dac-822c-6ea68535f31d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036373 Apr 12 13:06:54 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 366/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:56 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-deleted", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:56 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] Creating event network-vif-deleted:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:06:56 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-873e53e0-ebe4-46cd-94db-970b0e4e6fd4 req-425a8618-423e-4d02-8241-98fecef8a637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Apr 12 13:06:56 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 372/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:06:56 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-plugged", "status": "completed", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}, {"server_uuid": "2888a6ec-4c3a-44ee-809b-c1ea4a560aa1", "name": "network-vif-plugged", "status": "completed", "tag": "f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:06:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:06:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:06:56 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:06:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Creating event network-vif-plugged:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:06:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] Creating event network-vif-plugged:f1b0ea0e-f3a9-403c-9f4e-6fad1c9ef4ac for instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 on user Apr 12 13:06:56 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-2bd82564-a171-45c4-b2c6-fbf6692c3d1e req-5f5dba95-3ba2-4bfc-96c4-22c11cce42c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038474 Apr 12 13:06:56 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 372/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:07:28 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:07:28 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a2eb5df8-58cb-4a42-b7fe-14e02697bc30 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1755 microversion: 2.87 time: 0.162477 Apr 12 13:07:28 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 367/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:07:28 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:44 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] HTTP exception thrown: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. Apr 12 13:07:44 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Request method failure captured: Apr 12 13:07:44 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 HTTP/1.1 Apr 12 13:07:44 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:07:44 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:07:44 user devstack@n-api.service[61615]: Connection: close Apr 12 13:07:44 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:07:44 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:07:44 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:07:44 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:07:44 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNquAZHX8Jn6W05RAIkk1YdCB5aQTUNdO3KKCpXgDAsInsmOPCu7tt4zLvJJqz8ShBnrn09b41cGDMVpm4BTjQZQPI39q-cDs5aKeF6ImO6-rPBxUZfSsfCaZNoVT0gFI6La4n5AoELQboZ6If4ACeWbtvIMsI_0NDvbzJfG3wHhZCL4 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Project-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestStampPattern-1801373189 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Tenant: tempest-TestStampPattern-1801373189 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Tenant-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestStampPattern-1801373189 Apr 12 13:07:44 user devstack@n-api.service[61615]: X-User: tempest-TestStampPattern-1801373189-project-member Apr 12 13:07:44 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:07:44 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:07:44 user devstack@n-api.service[61615]: X-User-Id: bc5b75e437444fe4a54c1516964f0cfa Apr 12 13:07:44 user devstack@n-api.service[61615]: X-User-Name: tempest-TestStampPattern-1801373189-project-member Apr 12 13:07:44 user devstack@n-api.service[61615]: method: > Apr 12 13:07:44 user devstack@n-api.service[61615]: exception: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. Apr 12 13:07:44 user devstack@n-api.service[61615]: action_args: {'id': '2888a6ec-4c3a-44ee-809b-c1ea4a560aa1'} Apr 12 13:07:44 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:44 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:07:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:07:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:07:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:07:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. Apr 12 13:07:45 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:07:45 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Returning 404 to user: Instance 2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:07:45 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-9f589c21-962d-44a3-a9c9-9ed523b3976e tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1" status: 404 len: 111 microversion: 2.1 time: 0.043175 Apr 12 13:07:45 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 373/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:07:44 2023] GET /compute/v2.1/servers/2888a6ec-4c3a-44ee-809b-c1ea4a560aa1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=14 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:49 user devstack@n-api.service[61614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:07:49 user devstack@n-api.service[61614]: Wed Apr 12 13:07:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979 (ip 10.0.0.210) !!! Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] HTTP exception thrown: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is not attached to volume 2c6757bb-c886-4df6-a70f-abdf3f611979 Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Request method failure captured: Apr 12 13:07:49 user devstack@n-api.service[61614]: request: DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979 HTTP/1.1 Apr 12 13:07:49 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:07:49 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:07:49 user devstack@n-api.service[61614]: Connection: close Apr 12 13:07:49 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:07:49 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:07:49 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:07:49 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:07:49 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNquAZHX8Jn6W05RAIkk1YdCB5aQTUNdO3KKCpXgDAsInsmOPCu7tt4zLvJJqz8ShBnrn09b41cGDMVpm4BTjQZQPI39q-cDs5aKeF6ImO6-rPBxUZfSsfCaZNoVT0gFI6La4n5AoELQboZ6If4ACeWbtvIMsI_0NDvbzJfG3wHhZCL4 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Project-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Project-Name: tempest-TestStampPattern-1801373189 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Tenant: tempest-TestStampPattern-1801373189 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Tenant-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-TestStampPattern-1801373189 Apr 12 13:07:49 user devstack@n-api.service[61614]: X-User: tempest-TestStampPattern-1801373189-project-member Apr 12 13:07:49 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:07:49 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:07:49 user devstack@n-api.service[61614]: X-User-Id: bc5b75e437444fe4a54c1516964f0cfa Apr 12 13:07:49 user devstack@n-api.service[61614]: X-User-Name: tempest-TestStampPattern-1801373189-project-member Apr 12 13:07:49 user devstack@n-api.service[61614]: method: > Apr 12 13:07:49 user devstack@n-api.service[61614]: exception: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is not attached to volume 2c6757bb-c886-4df6-a70f-abdf3f611979 Apr 12 13:07:49 user devstack@n-api.service[61614]: action_args: {'server_id': 'e47cf07b-9759-4350-9e10-bd5bb15678f3', 'id': '2c6757bb-c886-4df6-a70f-abdf3f611979'} Apr 12 13:07:49 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2c6757bb-c886-4df6-a70f-abdf3f611979. Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is not attached to volume 2c6757bb-c886-4df6-a70f-abdf3f611979 Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is not attached to volume 2c6757bb-c886-4df6-a70f-abdf3f611979 Apr 12 13:07:49 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:07:49 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Returning 404 to user: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 is not attached to volume 2c6757bb-c886-4df6-a70f-abdf3f611979 {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:07:49 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-870a0148-15d2-4af7-ad4e-2ab60677dc01 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979" status: 404 len: 154 microversion: 2.1 time: 0.118208 Apr 12 13:07:49 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 373/1113] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 13:07:49 2023] DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3/os-volume_attachments/2c6757bb-c886-4df6-a70f-abdf3f611979 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:50 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:50 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] Creating event network-changed:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:07:50 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-88c0c04b-2179-4afa-a4e0-29a9af510092 req-66618016-5b8a-4a2e-983d-ef72f06ab861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028255 Apr 12 13:07:50 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 374/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:07:50 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:07:50 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-f3f50095-b183-4f36-8785-e407ce9b18aa tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 204 len: 0 microversion: 2.1 time: 0.121085 Apr 12 13:07:50 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 368/1115] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:07:50 2023] DELETE /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:50 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5b75e437444fe4a54c1516964f0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51e624010914d7680080956cbb0c720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:07:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-fa855df1-0ebd-4382-b0eb-f042cccac88a tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 200 len: 1660 microversion: 2.1 time: 0.164302 Apr 12 13:07:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 374/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:07:50 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 1660 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:07:52 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}, {"server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}, {"server_uuid": "e47cf07b-9759-4350-9e10-bd5bb15678f3", "name": "network-vif-deleted", "tag": "2f2f437b-b72e-4842-9047-36ee6e17bf9b"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:07:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:07:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:07:52 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:07:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Creating event network-vif-unplugged:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:07:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Creating event network-vif-plugged:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:07:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] Creating event network-vif-deleted:2f2f437b-b72e-4842-9047-36ee6e17bf9b for instance e47cf07b-9759-4350-9e10-bd5bb15678f3 on user Apr 12 13:07:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-c409319d-546b-4ee2-8525-1eb214f82d25 req-baf29ea4-4dd4-4606-906f-ec68680885bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030384 Apr 12 13:07:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 375/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:07:52 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:29 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:29 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-04d17242-ee0e-4e59-800b-f815d150d3d3 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1/action" status: 202 len: 0 microversion: 2.87 time: 0.080389 Apr 12 13:08:29 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 369/1118] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 13:08:29 2023] POST /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=12 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:08:29 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:08:29 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-c8a7817c-812f-4b9b-a0bc-466be11ab5bd tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1763 microversion: 2.87 time: 0.169292 Apr 12 13:08:29 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 375/1119] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:08:29 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1763 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:29 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] Creating event network-vif-unplugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:08:29 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-0ed29ef5-5f27-4c5d-a795-bad8de210428 req-6c6cd3c8-d720-425d-81cc-7df839835211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036055 Apr 12 13:08:29 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 376/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:08:31 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}, {"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:08:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:32 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:08:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:08:32 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-b09ea851-95d6-4789-a9dc-84e01b4e5c4d req-14f5cddc-8586-4f2c-8538-1a1b8719017d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070053 Apr 12 13:08:32 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 370/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:08:34 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:08:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:34 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:08:34 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-8fdb4dd3-6cb8-4e7b-b910-c799786cf6ad req-a0072ea4-f90b-4a38-b6e9-e00a041c78a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Apr 12 13:08:34 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 376/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:08:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] [instance: e47cf07b-9759-4350-9e10-bd5bb15678f3] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:08:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.wsgi [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] HTTP exception thrown: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Request method failure captured: Apr 12 13:08:40 user devstack@n-api.service[61615]: request: GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 HTTP/1.1 Apr 12 13:08:40 user devstack@n-api.service[61615]: Accept: application/json Apr 12 13:08:40 user devstack@n-api.service[61615]: Accept-Encoding: identity Apr 12 13:08:40 user devstack@n-api.service[61615]: Connection: close Apr 12 13:08:40 user devstack@n-api.service[61615]: Content-Length: 0 Apr 12 13:08:40 user devstack@n-api.service[61615]: Content-Type: application/json Apr 12 13:08:40 user devstack@n-api.service[61615]: Host: 10.0.0.210 Apr 12 13:08:40 user devstack@n-api.service[61615]: Openstack-System-Scope: None Apr 12 13:08:40 user devstack@n-api.service[61615]: User-Agent: python-urllib3/1.26.15 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Auth-Token: gAAAAABkNquAZHX8Jn6W05RAIkk1YdCB5aQTUNdO3KKCpXgDAsInsmOPCu7tt4zLvJJqz8ShBnrn09b41cGDMVpm4BTjQZQPI39q-cDs5aKeF6ImO6-rPBxUZfSsfCaZNoVT0gFI6La4n5AoELQboZ6If4ACeWbtvIMsI_0NDvbzJfG3wHhZCL4 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Domain-Id: None Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Domain-Name: None Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Identity-Status: Confirmed Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Is-Admin-Project: True Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Project-Domain-Id: default Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Project-Domain-Name: Default Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Project-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Project-Name: tempest-TestStampPattern-1801373189 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Role: member,reader Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Roles: member,reader Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51e624010914d7680080956cbb0c720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51e624010914d7680080956cbb0c720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Tenant: tempest-TestStampPattern-1801373189 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Tenant-Id: f51e624010914d7680080956cbb0c720 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-Tenant-Name: tempest-TestStampPattern-1801373189 Apr 12 13:08:40 user devstack@n-api.service[61615]: X-User: tempest-TestStampPattern-1801373189-project-member Apr 12 13:08:40 user devstack@n-api.service[61615]: X-User-Domain-Id: default Apr 12 13:08:40 user devstack@n-api.service[61615]: X-User-Domain-Name: Default Apr 12 13:08:40 user devstack@n-api.service[61615]: X-User-Id: bc5b75e437444fe4a54c1516964f0cfa Apr 12 13:08:40 user devstack@n-api.service[61615]: X-User-Name: tempest-TestStampPattern-1801373189-project-member Apr 12 13:08:40 user devstack@n-api.service[61615]: method: > Apr 12 13:08:40 user devstack@n-api.service[61615]: exception: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. Apr 12 13:08:40 user devstack@n-api.service[61615]: action_args: {'id': 'e47cf07b-9759-4350-9e10-bd5bb15678f3'} Apr 12 13:08:40 user devstack@n-api.service[61615]: {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. Apr 12 13:08:40 user devstack@n-api.service[61615]: ERROR nova.api.openstack.wsgi Apr 12 13:08:40 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Returning 404 to user: Instance e47cf07b-9759-4350-9e10-bd5bb15678f3 could not be found. {{(pid=61615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:08:40 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-76cf72d3-152b-4846-b0c4-c2c827c567d2 tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3" status: 404 len: 111 microversion: 2.1 time: 0.040845 Apr 12 13:08:40 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 377/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:08:40 2023] GET /compute/v2.1/servers/e47cf07b-9759-4350-9e10-bd5bb15678f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 13:08:43 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-2846dcbb-a4f5-4eb8-9abe-391faa78c7bf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] Calling method '.version_select at 0x7fc95d26ba30>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:08:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:43 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:08:43 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-2846dcbb-a4f5-4eb8-9abe-391faa78c7bf tempest-TestStampPattern-1801373189 tempest-TestStampPattern-1801373189-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-193639278" status: 202 len: 0 microversion: 2.1 time: 0.041727 Apr 12 13:08:43 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 371/1124] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 13:08:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-193639278 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 13:09:19 user devstack@n-api.service[61614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b92cd933-8b66-465b-92f2-f8b6cc9bf4c6] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=8 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:09:19 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:09:19 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-6b9dd42a-a35c-4723-bb78-ff9d724575c0 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1769 microversion: 2.87 time: 0.156295 Apr 12 13:09:19 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 377/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:09:19 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1769 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:10:19 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:10:19 user devstack@n-api.service[61615]: Wed Apr 12 13:10:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 (ip 10.0.0.210) !!! Apr 12 13:10:19 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:10:19 user devstack@n-api.service[61615]: Wed Apr 12 13:10:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 (ip 10.0.0.210) !!! Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:19 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:10:19 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-5a6c0bab-3927-46c1-930e-2a16a21b99ff tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 204 len: 0 microversion: 2.87 time: 0.394320 Apr 12 13:10:19 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 378/1126] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 13:10:19 2023] DELETE /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 13:10:19 user devstack@n-api.service[61616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:10:19 user devstack@n-api.service[61616]: Wed Apr 12 13:10:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 (ip 10.0.0.210) !!! Apr 12 13:10:19 user devstack@n-api.service[61616]: ERROR oslo.messaging._drivers.impl_rabbit [-] [180aff15-dcfb-446e-97bb-cfb259734611] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 13:10:19 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:10:19 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:10:19 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:10:20 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:10:20 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-fc3aa814-292f-46e1-8d92-dc19a7936031 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 200 len: 1775 microversion: 2.87 time: 0.329010 Apr 12 13:10:20 user devstack@n-api.service[61614]: INFO oslo.messaging._drivers.impl_rabbit [-] [b92cd933-8b66-465b-92f2-f8b6cc9bf4c6] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37630. Apr 12 13:10:20 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 372/1127] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:10:19 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 1775 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:20 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] Creating event network-vif-unplugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:10:20 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-8cd45f09-eadf-4fd8-ac6d-28b51cb42e17 req-6ee0f0fc-2154-4e51-ade5-e67b433dc467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127282 Apr 12 13:10:20 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 378/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:10:21 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-deleted", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:10:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:22 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] Creating event network-vif-deleted:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:10:22 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-f7f8010f-10df-4a02-8f3b-33f20038de3e req-44b93be6-5f96-4f0d-9bb4-ceb28a5ba030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031652 Apr 12 13:10:22 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 379/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:10:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:10:22 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1820783-afa6-434c-9da4-09d9c4990fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd889e8-1b3d-4902-ad45-01a3b961d658"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:10:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:10:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:10:22 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:10:22 user devstack@n-api.service[61616]: INFO oslo.messaging._drivers.impl_rabbit [-] [180aff15-dcfb-446e-97bb-cfb259734611] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37636. Apr 12 13:10:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] Creating event network-vif-plugged:3bd889e8-1b3d-4902-ad45-01a3b961d658 for instance d1820783-afa6-434c-9da4-09d9c4990fa1 on user Apr 12 13:10:22 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-4c95b231-1a85-4b91-a617-4d9b625e6dc2 req-ba8eb056-2d36-4a5f-8374-242d24376801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Apr 12 13:10:22 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 373/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: d1820783-afa6-434c-9da4-09d9c4990fa1] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HTTP exception thrown: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Request method failure captured: Apr 12 13:11:10 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 HTTP/1.1 Apr 12 13:11:10 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:11:10 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:11:10 user devstack@n-api.service[61614]: Connection: close Apr 12 13:11:10 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:11:10 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:11:10 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:11:10 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:11:10 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqm9UreqH8cSfSqgobaBzKuvIsxrKZybRO2QGKtM9K_NTF5yhLzKDjAZkZXBZZH5cY6xfwk7yJQw4ra5w1BZ9blW9xh5pqNhMOx1vUYwi4QbKhtc2d2Fb4yHEak5WhPGHKMICsL3Q5p2PjC0-dfGPheu3VPEnF54RadgK0K4QA_KfJ8 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Project-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Tenant-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:11:10 user devstack@n-api.service[61614]: X-User: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:11:10 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:11:10 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:11:10 user devstack@n-api.service[61614]: X-User-Id: 435e0d6fd2b3437f837e82730b4d955f Apr 12 13:11:10 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:11:10 user devstack@n-api.service[61614]: method: > Apr 12 13:11:10 user devstack@n-api.service[61614]: exception: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. Apr 12 13:11:10 user devstack@n-api.service[61614]: action_args: {'id': 'd1820783-afa6-434c-9da4-09d9c4990fa1'} Apr 12 13:11:10 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. Apr 12 13:11:10 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:11:10 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Returning 404 to user: Instance d1820783-afa6-434c-9da4-09d9c4990fa1 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:11:10 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-25269eca-aacf-43ed-81f1-45b5d6356dac tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1" status: 404 len: 111 microversion: 2.87 time: 0.054145 Apr 12 13:11:10 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 379/1131] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:11:10 2023] GET /compute/v2.1/servers/d1820783-afa6-434c-9da4-09d9c4990fa1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:10 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:11:10 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-fba55609-e42b-485d-a68d-4848b6a86ef6 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 204 len: 0 microversion: 2.87 time: 0.135148 Apr 12 13:11:10 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 380/1132] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 13:11:10 2023] DELETE /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=8 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:11:10 user devstack@n-api.service[61616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 13:11:10 user devstack@n-api.service[61616]: Wed Apr 12 13:11:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e (ip 10.0.0.210) !!! Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:10 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:11:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:11:11 user devstack@n-api.service[61616]: DEBUG nova.policy [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61616) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:11:11 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-99cbf386-7623-4b93-9cb8-2617e3c04e3a tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 200 len: 1697 microversion: 2.87 time: 0.242593 Apr 12 13:11:11 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 374/1133] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:11:10 2023] GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:11:11 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "name": "network-vif-unplugged", "status": "completed", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:11:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:11 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] Creating event network-vif-unplugged:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:11:11 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-0804b32b-a07d-44db-bf85-9c0abaedfc17 req-6b4b17cc-4f3a-4ee0-a051-2cf430858e7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092490 Apr 12 13:11:11 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 380/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 13:11:13 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "name": "network-vif-plugged", "status": "completed", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}, {"server_uuid": "acd99758-64c1-4852-b906-e5f941868a8e", "name": "network-vif-deleted", "tag": "6afd3a74-bd8e-488e-be66-9f25ef4dce8d"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:11:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:11:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:11:13 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:11:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Creating event network-vif-plugged:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:11:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] Creating event network-vif-deleted:6afd3a74-bd8e-488e-be66-9f25ef4dce8d for instance acd99758-64c1-4852-b906-e5f941868a8e on user Apr 12 13:11:13 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-45b52b5f-c858-451d-a7ea-2eebcaa7123f req-a73ac50c-0e52-477d-ba9a-8af2f9517816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030461 Apr 12 13:11:13 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 381/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:11:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: acd99758-64c1-4852-b906-e5f941868a8e] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HTTP exception thrown: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Request method failure captured: Apr 12 13:12:01 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e HTTP/1.1 Apr 12 13:12:01 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:12:01 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:12:01 user devstack@n-api.service[61616]: Connection: close Apr 12 13:12:01 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:12:01 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:12:01 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:12:01 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:12:01 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqm9UreqH8cSfSqgobaBzKuvIsxrKZybRO2QGKtM9K_NTF5yhLzKDjAZkZXBZZH5cY6xfwk7yJQw4ra5w1BZ9blW9xh5pqNhMOx1vUYwi4QbKhtc2d2Fb4yHEak5WhPGHKMICsL3Q5p2PjC0-dfGPheu3VPEnF54RadgK0K4QA_KfJ8 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Project-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Tenant-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:01 user devstack@n-api.service[61616]: X-User: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:12:01 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:12:01 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:12:01 user devstack@n-api.service[61616]: X-User-Id: 435e0d6fd2b3437f837e82730b4d955f Apr 12 13:12:01 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:12:01 user devstack@n-api.service[61616]: method: > Apr 12 13:12:01 user devstack@n-api.service[61616]: exception: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. Apr 12 13:12:01 user devstack@n-api.service[61616]: action_args: {'id': 'acd99758-64c1-4852-b906-e5f941868a8e'} Apr 12 13:12:01 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. Apr 12 13:12:01 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Returning 404 to user: Instance acd99758-64c1-4852-b906-e5f941868a8e could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:12:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-a3cf2953-36da-48df-bb2a-37e6a010dce7 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e" status: 404 len: 111 microversion: 2.87 time: 0.033563 Apr 12 13:12:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 375/1136] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:12:01 2023] GET /compute/v2.1/servers/acd99758-64c1-4852-b906-e5f941868a8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Going to try to terminate instance {{(pid=61614) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:12:01 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-acc541ca-abd2-4e54-90c8-fb4a78625075 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 204 len: 0 microversion: 2.87 time: 0.117262 Apr 12 13:12:01 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 381/1137] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 13:12:01 2023] DELETE /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-unplugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] Creating event network-vif-unplugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-21944684-46f8-4c38-86ac-7131390ddbd6 req-a3503189-b2d8-4ed1-ae06-a220bc4cdb37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035391 Apr 12 13:12:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 376/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:01 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:01 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-a489e52c-11e1-4148-ab37-f855249c0e53 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 200 len: 1776 microversion: 2.87 time: 0.270823 Apr 12 13:12:01 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 382/1139] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:12:01 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 1776 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:12:03 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-plugged", "status": "completed", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}, {"server_uuid": "38198e86-bd23-4196-98a0-79455206305f", "name": "network-vif-deleted", "tag": "5621687b-5d0b-47f7-b11c-a24c403a590a"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:12:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:03 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Creating event network-vif-plugged:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:12:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] Creating event network-vif-deleted:5621687b-5d0b-47f7-b11c-a24c403a590a for instance 38198e86-bd23-4196-98a0-79455206305f on user Apr 12 13:12:03 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-adaa9e18-8276-4b51-85f1-15ea03e82880 req-dc9b2635-37b7-4e4b-90d5-5029a800504e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030463 Apr 12 13:12:03 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 382/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:12:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: 38198e86-bd23-4196-98a0-79455206305f] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.wsgi [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HTTP exception thrown: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Request method failure captured: Apr 12 13:12:51 user devstack@n-api.service[61616]: request: GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f HTTP/1.1 Apr 12 13:12:51 user devstack@n-api.service[61616]: Accept: application/json Apr 12 13:12:51 user devstack@n-api.service[61616]: Accept-Encoding: identity Apr 12 13:12:51 user devstack@n-api.service[61616]: Connection: close Apr 12 13:12:51 user devstack@n-api.service[61616]: Content-Length: 0 Apr 12 13:12:51 user devstack@n-api.service[61616]: Content-Type: application/json Apr 12 13:12:51 user devstack@n-api.service[61616]: Host: 10.0.0.210 Apr 12 13:12:51 user devstack@n-api.service[61616]: Openstack-System-Scope: None Apr 12 13:12:51 user devstack@n-api.service[61616]: User-Agent: python-urllib3/1.26.15 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Auth-Token: gAAAAABkNqm9UreqH8cSfSqgobaBzKuvIsxrKZybRO2QGKtM9K_NTF5yhLzKDjAZkZXBZZH5cY6xfwk7yJQw4ra5w1BZ9blW9xh5pqNhMOx1vUYwi4QbKhtc2d2Fb4yHEak5WhPGHKMICsL3Q5p2PjC0-dfGPheu3VPEnF54RadgK0K4QA_KfJ8 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Domain-Id: None Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Domain-Name: None Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Identity-Status: Confirmed Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Is-Admin-Project: True Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Project-Domain-Id: default Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Project-Domain-Name: Default Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Project-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Role: member,reader Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Roles: member,reader Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Tenant-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:12:51 user devstack@n-api.service[61616]: X-User: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:12:51 user devstack@n-api.service[61616]: X-User-Domain-Id: default Apr 12 13:12:51 user devstack@n-api.service[61616]: X-User-Domain-Name: Default Apr 12 13:12:51 user devstack@n-api.service[61616]: X-User-Id: 435e0d6fd2b3437f837e82730b4d955f Apr 12 13:12:51 user devstack@n-api.service[61616]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:12:51 user devstack@n-api.service[61616]: method: > Apr 12 13:12:51 user devstack@n-api.service[61616]: exception: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. Apr 12 13:12:51 user devstack@n-api.service[61616]: action_args: {'id': '38198e86-bd23-4196-98a0-79455206305f'} Apr 12 13:12:51 user devstack@n-api.service[61616]: {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. Apr 12 13:12:51 user devstack@n-api.service[61616]: ERROR nova.api.openstack.wsgi Apr 12 13:12:51 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Returning 404 to user: Instance 38198e86-bd23-4196-98a0-79455206305f could not be found. {{(pid=61616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:12:51 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-071b377e-5bc4-4f87-b2f3-a06569c7d58d tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f" status: 404 len: 111 microversion: 2.87 time: 0.035267 Apr 12 13:12:51 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 377/1141] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:12:51 2023] GET /compute/v2.1/servers/38198e86-bd23-4196-98a0-79455206305f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:51 user devstack@n-api.service[61615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [29f73ed0-2f3c-4f44-b4de-615d0dc751e6] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=4 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:51 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Going to try to terminate instance {{(pid=61615) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:12:52 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-eeafc2b6-5e82-4548-9b02-6a6aaab6c10b tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 204 len: 0 microversion: 2.87 time: 0.131640 Apr 12 13:12:52 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 383/1142] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 13:12:51 2023] DELETE /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:12:52 user devstack@n-api.service[61614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:12:52 user devstack@n-api.service[61614]: Wed Apr 12 13:12:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 (ip 10.0.0.210) !!! Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:52 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '435e0d6fd2b3437f837e82730b4d955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ad21427a04683b9b102d2ff0290a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:12:52 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-541af08d-4f83-4e41-8a10-720d9734e2da tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 200 len: 1697 microversion: 2.87 time: 0.243934 Apr 12 13:12:52 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 383/1143] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:12:52 2023] GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 13:12:52 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "name": "network-vif-unplugged", "status": "completed", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:12:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:52 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] Creating event network-vif-unplugged:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 13:12:52 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-08e366b7-1f84-4ea5-8ce5-2e2f0b9a0ab7 req-38c84cf8-b8a0-45d2-89f2-7f2bd56e5bdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028156 Apr 12 13:12:52 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 378/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:12:54 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "name": "network-vif-plugged", "status": "completed", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}, {"server_uuid": "e0752f9c-73b1-4cb8-82a9-ca6ce9141a26", "name": "network-vif-deleted", "tag": "9f228391-1910-4bd3-b317-f1afa3e98a0f"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:12:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:12:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:12:54 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:12:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Creating event network-vif-plugged:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 13:12:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] Creating event network-vif-deleted:9f228391-1910-4bd3-b317-f1afa3e98a0f for instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 on user Apr 12 13:12:54 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-60e2c15b-e40e-4039-ab5d-0b5da76fb283 req-49a19552-1ece-4a18-95b0-e9ab8128ca48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032649 Apr 12 13:12:54 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 384/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] [instance: e0752f9c-73b1-4cb8-82a9-ca6ce9141a26] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=4 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:13:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] HTTP exception thrown: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Request method failure captured: Apr 12 13:13:42 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 HTTP/1.1 Apr 12 13:13:42 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:13:42 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:13:42 user devstack@n-api.service[61614]: Connection: close Apr 12 13:13:42 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:13:42 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:13:42 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:13:42 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:13:42 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNqm9UreqH8cSfSqgobaBzKuvIsxrKZybRO2QGKtM9K_NTF5yhLzKDjAZkZXBZZH5cY6xfwk7yJQw4ra5w1BZ9blW9xh5pqNhMOx1vUYwi4QbKhtc2d2Fb4yHEak5WhPGHKMICsL3Q5p2PjC0-dfGPheu3VPEnF54RadgK0K4QA_KfJ8 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Project-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f20ad21427a04683b9b102d2ff0290a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Tenant-Id: f20ad21427a04683b9b102d2ff0290a5 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513 Apr 12 13:13:42 user devstack@n-api.service[61614]: X-User: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:13:42 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:13:42 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:13:42 user devstack@n-api.service[61614]: X-User-Id: 435e0d6fd2b3437f837e82730b4d955f Apr 12 13:13:42 user devstack@n-api.service[61614]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member Apr 12 13:13:42 user devstack@n-api.service[61614]: method: > Apr 12 13:13:42 user devstack@n-api.service[61614]: exception: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. Apr 12 13:13:42 user devstack@n-api.service[61614]: action_args: {'id': 'e0752f9c-73b1-4cb8-82a9-ca6ce9141a26'} Apr 12 13:13:42 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. Apr 12 13:13:42 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:13:42 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] Returning 404 to user: Instance e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:13:42 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-5a19d49c-77fa-4d2e-8fdd-81f994f07d66 tempest-ServerBootFromVolumeStableRescueTest-636247513 tempest-ServerBootFromVolumeStableRescueTest-636247513-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26" status: 404 len: 111 microversion: 2.87 time: 0.043519 Apr 12 13:13:42 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 384/1146] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 13:13:42 2023] GET /compute/v2.1/servers/e0752f9c-73b1-4cb8-82a9-ca6ce9141a26 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-43772807", "imageRef": "10cdaa6e-1722-4d2a-835d-7b112d771c50", "flavorRef": "42", "networks": [{"uuid": "41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1"}]}} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.network.neutron [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] validate_networks() for [('41ec14a2-1d8a-43b4-b9f5-0c3a5fdbe2e1', None, None, None, None, None)] {{(pid=61616) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Flavor limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Image limits 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Flavor pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Image pref 0:0:0 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.virt.hardware [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Getting quotas for project b40d4c1f298b4586a9b8bc8764605d03. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.quota [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Getting quotas for user 664243c5d28d42178333c2dadda1f105 and project b40d4c1f298b4586a9b8bc8764605d03. Resources: {'cores', 'ram', 'instances'} {{(pid=61616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Going to run 1 instances... {{(pid=61616) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 13:14:04 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='10cdaa6e-1722-4d2a-835d-7b112d771c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 13:14:04 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-4de41a48-438c-4936-bbe3-4a7ad4eb1192 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.694984 Apr 12 13:14:04 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 379/1147] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 13:14:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 13:14:04 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:04 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:04 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] [29f73ed0-2f3c-4f44-b4de-615d0dc751e6] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44402. Apr 12 13:14:04 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-2602a441-6e15-41d1-ad5d-ea2428166b48 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:14:04 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-2602a441-6e15-41d1-ad5d-ea2428166b48 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:14:04 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-2602a441-6e15-41d1-ad5d-ea2428166b48 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664243c5d28d42178333c2dadda1f105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40d4c1f298b4586a9b8bc8764605d03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:14:04 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-2602a441-6e15-41d1-ad5d-ea2428166b48 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba" status: 200 len: 1206 microversion: 2.1 time: 0.084453 Apr 12 13:14:04 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 385/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:14:04 2023] GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba => generated 1206 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:07 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] Creating event network-changed:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:14:07 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-ead6672d-eceb-42b1-b149-38ced80b3386 req-9ab8868c-d78f-451d-9d00-ec664b874d3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034027 Apr 12 13:14:07 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 385/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:14:09 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "name": "network-vif-plugged", "status": "completed", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:14:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:09 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] Creating event network-vif-plugged:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:14:09 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-7c1dfd38-c7a2-4d18-b50c-b875a0c119bd req-c6538682-21b8-4fa3-9621-71fa5b9ff6d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080232 Apr 12 13:14:09 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 380/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:14:11 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "name": "network-vif-plugged", "status": "completed", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:14:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:11 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] Creating event network-vif-plugged:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:14:11 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-acb72747-a1b7-43dc-b002-c93f3584da5f req-17e6e58a-b71c-44a3-bed2-fc144d8a0f1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028836 Apr 12 13:14:11 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 386/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:14:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:14:54 user devstack@n-api.service[61614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b92cd933-8b66-465b-92f2-f8b6cc9bf4c6] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:14:54 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:14:55 user devstack@n-api.service[61614]: DEBUG nova.policy [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664243c5d28d42178333c2dadda1f105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40d4c1f298b4586a9b8bc8764605d03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61614) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:14:55 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-37578702-d369-45eb-b376-e889253fdac8 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba" status: 200 len: 1483 microversion: 2.1 time: 0.155848 Apr 12 13:14:55 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 386/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:14:54 2023] GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba => generated 1483 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:15:59 user devstack@n-api.service[61616]: ERROR oslo.messaging._drivers.impl_rabbit [-] [180aff15-dcfb-446e-97bb-cfb259734611] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=2 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell0:SELECT=6 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG dbcounter [-] [61616] Writing DB stats nova_cell1:SELECT=4 {{(pid=61616) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Calling method '>' {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Fetching instance by UUID {{(pid=61616) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:15:59 user devstack@n-api.service[61616]: DEBUG nova.compute.api [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Going to try to terminate instance {{(pid=61616) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 13:15:59 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [None req-b53a67ce-7b1b-4dfe-ab91-7d39491e3893 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba" status: 204 len: 0 microversion: 2.1 time: 0.158724 Apr 12 13:15:59 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 381/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 13:15:59 2023] DELETE /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 13:15:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell0:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:15:59 user devstack@n-api.service[61615]: Wed Apr 12 13:15:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba (ip 10.0.0.210) !!! Apr 12 13:15:59 user devstack@n-api.service[61615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 13:15:59 user devstack@n-api.service[61615]: Wed Apr 12 13:15:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba (ip 10.0.0.210) !!! Apr 12 13:15:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_api:SELECT=6 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:15:59 user devstack@n-api.service[61615]: DEBUG dbcounter [-] [61615] Writing DB stats nova_cell1:SELECT=2 {{(pid=61615) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Calling method '>' {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG nova.compute.api [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Fetching instance by UUID {{(pid=61615) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:00 user devstack@n-api.service[61615]: DEBUG nova.policy [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '664243c5d28d42178333c2dadda1f105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40d4c1f298b4586a9b8bc8764605d03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61615) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 13:16:00 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [None req-1a19aa99-9178-4fb4-814f-d5cfe0094c79 tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba" status: 200 len: 1489 microversion: 2.1 time: 0.247869 Apr 12 13:16:00 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 387/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:15:59 2023] GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba => generated 1489 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=6 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "name": "network-vif-unplugged", "status": "completed", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:00 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:00 user devstack@n-api.service[61614]: INFO oslo.messaging._drivers.impl_rabbit [-] [b92cd933-8b66-465b-92f2-f8b6cc9bf4c6] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33708. Apr 12 13:16:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.compute.server_external_events [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] Creating event network-vif-unplugged:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:16:00 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [req-8f422cf6-d675-415c-9fb6-a91392e1b655 req-cd8eb7a8-d81d-4ed4-b5d0-f4fdc5f911f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045535 Apr 12 13:16:00 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 387/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:16:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:16:01 user devstack@n-api.service[61616]: DEBUG nova.api.openstack.wsgi [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "name": "network-vif-deleted", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:16:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:01 user devstack@n-api.service[61616]: DEBUG oslo_concurrency.lockutils [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61616) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.compute.server_external_events [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] Creating event network-vif-deleted:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:16:01 user devstack@n-api.service[61616]: INFO nova.api.openstack.requestlog [req-ded87d92-a78a-45b5-b376-28da5d42fcb1 req-14ff3fb4-2b2e-471b-86b4-7aa83fc80ab6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 Apr 12 13:16:01 user devstack@n-api.service[61616]: [pid: 61616|app: 0|req: 382/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 13:16:02 user devstack@n-api.service[61615]: DEBUG nova.api.openstack.wsgi [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c02ed35-402b-4473-b43d-6353b9ef06ba", "name": "network-vif-plugged", "status": "completed", "tag": "c56cb583-e7bf-463b-a5f5-42b513189d34"}]} {{(pid=61615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 13:16:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:02 user devstack@n-api.service[61615]: DEBUG oslo_concurrency.lockutils [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61615) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.compute.server_external_events [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] Creating event network-vif-plugged:c56cb583-e7bf-463b-a5f5-42b513189d34 for instance 1c02ed35-402b-4473-b43d-6353b9ef06ba on user Apr 12 13:16:02 user devstack@n-api.service[61615]: INFO nova.api.openstack.requestlog [req-40cc855e-809b-4525-910b-47b4d5f455fb req-f6c66edf-ef5b-4daa-ac56-ba22fdd7bf31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028289 Apr 12 13:16:02 user devstack@n-api.service[61615]: [pid: 61615|app: 0|req: 388/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 13:16:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Calling method '>' {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG nova.compute.api [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] [instance: 1c02ed35-402b-4473-b43d-6353b9ef06ba] Fetching instance by UUID {{(pid=61614) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_api:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG dbcounter [-] [61614] Writing DB stats nova_cell1:SELECT=2 {{(pid=61614) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Acquiring lock "f540a691-7739-42e1-92f6-c2721429f236" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG oslo_concurrency.lockutils [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Lock "f540a691-7739-42e1-92f6-c2721429f236" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61614) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 13:16:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.wsgi [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] HTTP exception thrown: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Request method failure captured: Apr 12 13:16:50 user devstack@n-api.service[61614]: request: GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba HTTP/1.1 Apr 12 13:16:50 user devstack@n-api.service[61614]: Accept: application/json Apr 12 13:16:50 user devstack@n-api.service[61614]: Accept-Encoding: identity Apr 12 13:16:50 user devstack@n-api.service[61614]: Connection: close Apr 12 13:16:50 user devstack@n-api.service[61614]: Content-Length: 0 Apr 12 13:16:50 user devstack@n-api.service[61614]: Content-Type: application/json Apr 12 13:16:50 user devstack@n-api.service[61614]: Host: 10.0.0.210 Apr 12 13:16:50 user devstack@n-api.service[61614]: Openstack-System-Scope: None Apr 12 13:16:50 user devstack@n-api.service[61614]: User-Agent: python-urllib3/1.26.15 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Auth-Token: gAAAAABkNq6aTDYyoQ-k8AxATZC5URlTV7trzAmAqwvF_naigdEfXY-zqrBqMuL9dh46jT4sloRc3U_YhaJ97_rF7nl2H7a5WXUrCHk97xxdeVrYimw9tKQmuRLaBoBhsw5g3lQzstIS7_IHSXfsoa_BRb5n1FiwTadpk1-hrIA6wNGVuVM_AkM Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Domain-Id: None Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Domain-Name: None Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Identity-Status: Confirmed Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Is-Admin-Project: True Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Project-Domain-Id: default Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Project-Domain-Name: Default Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Project-Id: b40d4c1f298b4586a9b8bc8764605d03 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Project-Name: tempest-VolumesActionsTest-838949396 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Role: member,reader Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Roles: member,reader Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b40d4c1f298b4586a9b8bc8764605d03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b40d4c1f298b4586a9b8bc8764605d03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b40d4c1f298b4586a9b8bc8764605d03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Tenant: tempest-VolumesActionsTest-838949396 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Tenant-Id: b40d4c1f298b4586a9b8bc8764605d03 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-Tenant-Name: tempest-VolumesActionsTest-838949396 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-User: tempest-VolumesActionsTest-838949396-project-member Apr 12 13:16:50 user devstack@n-api.service[61614]: X-User-Domain-Id: default Apr 12 13:16:50 user devstack@n-api.service[61614]: X-User-Domain-Name: Default Apr 12 13:16:50 user devstack@n-api.service[61614]: X-User-Id: 664243c5d28d42178333c2dadda1f105 Apr 12 13:16:50 user devstack@n-api.service[61614]: X-User-Name: tempest-VolumesActionsTest-838949396-project-member Apr 12 13:16:50 user devstack@n-api.service[61614]: method: > Apr 12 13:16:50 user devstack@n-api.service[61614]: exception: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. Apr 12 13:16:50 user devstack@n-api.service[61614]: action_args: {'id': '1c02ed35-402b-4473-b43d-6353b9ef06ba'} Apr 12 13:16:50 user devstack@n-api.service[61614]: {{(pid=61614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. Apr 12 13:16:50 user devstack@n-api.service[61614]: ERROR nova.api.openstack.wsgi Apr 12 13:16:50 user devstack@n-api.service[61614]: DEBUG nova.api.openstack.wsgi [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] Returning 404 to user: Instance 1c02ed35-402b-4473-b43d-6353b9ef06ba could not be found. {{(pid=61614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 13:16:50 user devstack@n-api.service[61614]: INFO nova.api.openstack.requestlog [None req-2843688b-b9c1-4a33-8115-d8f498d8799c tempest-VolumesActionsTest-838949396 tempest-VolumesActionsTest-838949396-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba" status: 404 len: 111 microversion: 2.1 time: 0.044524 Apr 12 13:16:50 user devstack@n-api.service[61614]: [pid: 61614|app: 0|req: 388/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 13:16:50 2023] GET /compute/v2.1/servers/1c02ed35-402b-4473-b43d-6353b9ef06ba => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)